-- Logs begin at Wed 2022-08-17 19:15:30 UTC, end at Wed 2022-08-17 20:43:00 UTC. -- Aug 17 19:58:37.620275 dv-cinder-835384-19-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 19:58:37.627719 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 19:58:37 2022] *** Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: nodename: dv-cinder-835384-19-iscsi Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: machine: x86_64 Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: clock source: unix Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: pcre jit disabled Aug 17 19:58:37.629722 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: detected number of CPU cores: 4 Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: current working directory: / Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: detected binary path: /usr/bin/uwsgi-core Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: your processes number limit is 47680 Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: your memory page size is 4096 bytes Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: detected max file descriptor number: 2048 Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: lock engine: pthread robust mutexes Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: thunder lock: enabled Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 19:58:37.630243 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 19:58:37.671255 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: Python main interpreter initialized at 0x55e4458379c0 Aug 17 19:58:37.671255 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: python threads support enabled Aug 17 19:58:37.671255 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: your server socket listen backlog is limited to 100 connections Aug 17 19:58:37.671255 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: your mercy for graceful operations on workers is 90 seconds Aug 17 19:58:37.671613 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 19:58:37.671712 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: *** Operational MODE: preforking *** Aug 17 19:58:37.672015 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: *** uWSGI is running in multiple interpreter mode *** Aug 17 19:58:37.672015 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: spawned uWSGI master process (pid: 81763) Aug 17 19:58:37.672218 dv-cinder-835384-19-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 17 19:58:37.673358 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: spawned uWSGI worker 1 (pid: 81778, cores: 1) Aug 17 19:58:37.673358 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: spawned uWSGI worker 2 (pid: 81779, cores: 1) Aug 17 19:58:37.673358 dv-cinder-835384-19-iscsi devstack@keystone.service[81763]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 19:58:42.060289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:42.060289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: from cryptography.utils import int_from_bytes Aug 17 19:58:42.061032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:42.061032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: from cryptography.utils import int_from_bytes Aug 17 19:58:42.061147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:42.061147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: from cryptography.utils import int_from_bytes Aug 17 19:58:42.061582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:42.061582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: from cryptography.utils import int_from_bytes Aug 17 19:58:42.112225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:58:42.112416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:58:42.112494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:58:42.112571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:58:42.112653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] command line args: [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:58:42.112723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] command line args: [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:58:42.112851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:58:42.112974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:58:42.113058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ================================================================================ {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:58:42.113163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ================================================================================ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:58:42.113273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] admin_token = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.113511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] admin_token = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.113603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] config_dir = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.113680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] config_dir = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.113753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.113833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.113926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] config_source = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.114002 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] config_source = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.114083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] debug = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.114198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] debug = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.114342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.115611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.115706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.115768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.115825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.115891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.115948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116126 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] list_limit = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116253 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] log_config_append = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] log_config_append = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] log_dir = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] log_dir = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] log_file = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] log_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.116952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.117983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.118161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.118299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.118461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.118599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.118925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.119892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] publish_errors = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] publish_errors = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.120986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] standard_threads = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] standard_threads = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.121913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122497 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] use_journal = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] use_journal = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] use_json = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] use_json = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.122930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] use_stderr = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.123007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] use_stderr = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.123082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] use_syslog = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.123151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] use_syslog = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.123251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.123335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:42.123498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.123576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.123738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.123830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124805 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.124980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.125964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.126957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.127950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.128953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129029 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.129918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.130984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.131978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132738 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.132992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.133950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.134925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.135988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.136950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.137873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.138998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.139976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.140988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.141970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142089 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.142942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.143910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.144947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.145903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.146942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.147926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.148884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] auth.external = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.149003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.149119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.149235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.external = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.149858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.149979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] auth.password = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150520 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] auth.token = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.password = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.150907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.token = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.151975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] credential.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.152934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.153943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.154947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.155065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.155262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.155386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.155509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.155629 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.155746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.156973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.157932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.158891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.159967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.160084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.160466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.160592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.160716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.160844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.160964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.161926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.162946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.163930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.164900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.165613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.165743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.165870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.166914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.167995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.168959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.169910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.170904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171152 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.171969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.172933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.173904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.174906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.175986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.176938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177535 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.177887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178129 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.178981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.179997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.180114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.180230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.180230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.180460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.180630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.180776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.180951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.181946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.182830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.183982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] role.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] role.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.184923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] role.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] role.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.185888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.186984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.187941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.188886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.189968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.190086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.190209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.190336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.190456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.190574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.190763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.190883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.191976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.192926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.193882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194253 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.194891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195253 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.195966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.196924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.connection = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.197907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.198993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.199926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.200876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:58:42.201824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:42.201824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:58:42.229145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.229444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.229639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.229960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.230201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.230437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.238410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.239394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.268565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.268761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.274081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.274081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.326793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.326967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.376051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.376280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.376517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.376758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.533873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.534120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.534331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.534556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.534755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.534842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.534993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.535087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.535218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.535438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.535658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.535876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.565501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.565693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.565781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.565889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.565974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.566892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.567026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.578803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.579014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.592243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.592474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.592656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.592748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.592891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.592974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593628 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.593971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:42.615344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.615467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.615536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:42.615626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:42.615894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.615976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.616093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:42.616179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:42.616369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.616450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.616633 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.616712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.617146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.617226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.617413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.617494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.626986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.627268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.627541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.627825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.628081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.628370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.628652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.628934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.635466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.636714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.638335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.638652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.638938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.639227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.639515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.639714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.639818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.639938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.640048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.640229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.640330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.640518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.640715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.640795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.640997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.641091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.641314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.641451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.641625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.642009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.642290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.642567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.664786 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.666275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.666482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.666599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.667992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.668283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.671299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.671586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.673943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.674046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.674046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.674046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.678214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.678504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.680032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.680328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.682602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.682913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.683196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.683482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.683761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.684041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.684316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.684588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.684777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.685076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.685364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.685655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.685938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.686219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.686496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.686799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.702555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.702866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.704806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.705096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.706719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.709027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.709917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.710221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.713016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.713321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.715260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.717530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.718343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.720693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.721682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.721982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.722273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.722561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.722867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.723161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.723963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.724267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.724561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.724851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.725136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.725420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.739271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.739571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.739871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.740114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.741311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.741614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.741887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.742157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.747523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.749040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.749327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.749701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.751505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.751586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.751958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.752246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.752529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.752833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.753121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.754143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.754432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.754740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.755051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.755344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.765045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.765421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.765979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.766275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.766560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.766871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.767164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.767286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.767580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.767870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.768159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.768446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.768760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.769113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.783143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.784825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.786143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.787888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.789029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.790709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.790941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.792178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.792394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.792486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.792758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.793879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.794167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.794471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.799234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.800674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.801113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.802575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.803582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.803874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.804171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.804486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.806148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.806489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.806899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.807188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.812967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.813261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.813545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.815243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.815542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.815831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.820470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.820759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.821043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.822010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.822294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.822582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.822886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.823161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.823418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:42.823502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.823713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.823803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.823992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.824081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.824257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.824347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.824531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.824611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.824792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.824871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.825082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.825356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.825629 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.825947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.826285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.826555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.826864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.827130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:42.858876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e4458379c0 pid: 81778 (default app) Aug 17 19:58:42.861705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e4458379c0 pid: 81779 (default app) Aug 17 19:58:42.862404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76535-a8dc-4771-8797-83836e05c098 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:42.862724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76535-a8dc-4771-8797-83836e05c098 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:42.863004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76535-a8dc-4771-8797-83836e05c098 None None] PATH_INFO: `/v3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:42.867127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Wed Aug 17 19:58:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:58:50.823269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62b7a-5923-4e29-b3aa-8498ed659c2a None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:50.823830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62b7a-5923-4e29-b3aa-8498ed659c2a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:50.823830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62b7a-5923-4e29-b3aa-8498ed659c2a None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:50.828316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:58:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:58:50.833993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:50.834451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:50.834614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:50.907379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: INFO dbcounter [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] Registered counter for database keystone Aug 17 19:58:50.931316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG oslo_db.sqlalchemy.engines [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:58:50.937855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writer thread running {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:58:51.127394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG passlib.handlers.bcrypt [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81778) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:58:51.127811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG passlib.handlers.bcrypt [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81778) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:58:51.185045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:58:51.186659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:58:51.323434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:58:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 19:58:51.809824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f62b7a-5923-4e29-b3aa-8498ed659c2a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:51.879857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: INFO dbcounter [None req-c9f62b7a-5923-4e29-b3aa-8498ed659c2a None None] Registered counter for database keystone Aug 17 19:58:51.901140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f62b7a-5923-4e29-b3aa-8498ed659c2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:58:51.907817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writer thread running {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:58:52.028020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f62b7a-5923-4e29-b3aa-8498ed659c2a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:52.032470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc98a9a-9b50-4c49-98fd-39cfe6a9c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:52.033103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98a9a-9b50-4c49-98fd-39cfe6a9c58f admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:52.033382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98a9a-9b50-4c49-98fd-39cfe6a9c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:52.033654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98a9a-9b50-4c49-98fd-39cfe6a9c58f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:52.041946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98a9a-9b50-4c49-98fd-39cfe6a9c58f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:52.094139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5fc98a9a-9b50-4c49-98fd-39cfe6a9c58f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:58:52.094482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98a9a-9b50-4c49-98fd-39cfe6a9c58f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:52.105145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 17 19:58:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 19:58:52.111291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:52.126245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259668c-da52-47b7-a765-aaaf91b6e672 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:52.130735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58896f-ff8a-4f54-b515-b3977ddbcd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:52.131830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58896f-ff8a-4f54-b515-b3977ddbcd3b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:52.132112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58896f-ff8a-4f54-b515-b3977ddbcd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:52.132387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58896f-ff8a-4f54-b515-b3977ddbcd3b admin admin] PATH_INFO: `/v3/projects/036067fc874c4d13970eee6f98f3d00e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:52.133953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58896f-ff8a-4f54-b515-b3977ddbcd3b admin admin] RBAC: Authorizing `identity:get_project(project_id=036067fc874c4d13970eee6f98f3d00e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:52.187211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d58896f-ff8a-4f54-b515-b3977ddbcd3b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:58:52.187555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58896f-ff8a-4f54-b515-b3977ddbcd3b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:52.192069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Aug 17 19:58:52 2022] GET /identity/v3/projects/036067fc874c4d13970eee6f98f3d00e => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:58:54.077888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349ed0-8c53-48df-a6c6-5ac3b0d7041d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:54.078404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349ed0-8c53-48df-a6c6-5ac3b0d7041d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:54.078404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349ed0-8c53-48df-a6c6-5ac3b0d7041d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:54.082491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:58:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:58:54.088779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b99f71-ebb9-4e54-8eb4-4a34816b4e6c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:54.089198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b99f71-ebb9-4e54-8eb4-4a34816b4e6c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:54.089344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b99f71-ebb9-4e54-8eb4-4a34816b4e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:54.112286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-55b99f71-ebb9-4e54-8eb4-4a34816b4e6c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:58:54.113918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-55b99f71-ebb9-4e54-8eb4-4a34816b4e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:58:54.122461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:58:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 19:58:54.395246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31349ed0-8c53-48df-a6c6-5ac3b0d7041d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:54.407645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31349ed0-8c53-48df-a6c6-5ac3b0d7041d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:54.411914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e23f7-1399-4dad-b81e-9b6d809cbfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:54.412520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e23f7-1399-4dad-b81e-9b6d809cbfbe admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:54.412806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e23f7-1399-4dad-b81e-9b6d809cbfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:54.413087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e23f7-1399-4dad-b81e-9b6d809cbfbe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:54.421492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e23f7-1399-4dad-b81e-9b6d809cbfbe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:54.423299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e23f7-1399-4dad-b81e-9b6d809cbfbe admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:54.432984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 17 19:58:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:58:54.438573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b99f71-ebb9-4e54-8eb4-4a34816b4e6c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:54.447799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b99f71-ebb9-4e54-8eb4-4a34816b4e6c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:54.452095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493ae9e-d0c2-4c66-90fc-5334a6bcf6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:54.452726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ae9e-d0c2-4c66-90fc-5334a6bcf6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:54.453012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ae9e-d0c2-4c66-90fc-5334a6bcf6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:54.453291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ae9e-d0c2-4c66-90fc-5334a6bcf6fb admin admin] PATH_INFO: `/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:54.454594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493ae9e-d0c2-4c66-90fc-5334a6bcf6fb admin admin] RBAC: Authorizing `identity:get_user(user_id=55cfb5b1f26a4ec19b12e7ce5108fd60)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:54.456447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493ae9e-d0c2-4c66-90fc-5334a6bcf6fb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:54.457979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Wed Aug 17 19:58:54 2022] GET /identity/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:58:56.476908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a3f5-a28c-4968-9c61-b76bd60bc300 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:56.477457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a3f5-a28c-4968-9c61-b76bd60bc300 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:56.477544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a3f5-a28c-4968-9c61-b76bd60bc300 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:56.478876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:58:56.484390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aae06-34d3-4882-8309-75c96b6bb739 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:56.484854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aae06-34d3-4882-8309-75c96b6bb739 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:56.485064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aae06-34d3-4882-8309-75c96b6bb739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:56.503521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d06aae06-34d3-4882-8309-75c96b6bb739 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:58:56.504724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d06aae06-34d3-4882-8309-75c96b6bb739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:58:56.517323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cb7e6-8e33-478c-bce5-e6c235ca292e None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:56.517601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cb7e6-8e33-478c-bce5-e6c235ca292e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:56.517884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cb7e6-8e33-478c-bce5-e6c235ca292e None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:56.519318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:58:56.525199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:56.525484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:56.525762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:56.568105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG passlib.handlers.bcrypt [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81779) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:58:56.568523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG passlib.handlers.bcrypt [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81779) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:58:56.588967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:58:56.614688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:58:56.616353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:58:56.718611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:58:56.859408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aae06-34d3-4882-8309-75c96b6bb739 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:56.883122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:58:56.966415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aae06-34d3-4882-8309-75c96b6bb739 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:56.989612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:57.001017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.001662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.001949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.002236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.015052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:58:57.023662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:58:57.024678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:58:57.025983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:58:57.031045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:57.095277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398dad6-6b16-49c9-b9b0-aa17bc3bf134 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:57.097630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:58:57.114447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:58:57.132601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627f8a5-a513-458a-b0fb-4ba7867efe0f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:57.136392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.136392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.136392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.136392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.167596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.168275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.168566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.168846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.169534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:58:57.169868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:57.171314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:57.184303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:58:57.189902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:57.206001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:57.207553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:57.297866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1094c-cb47-4e9d-b71d-1a6ff439f984 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:57.316778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:58:57.323365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:57.326503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:58:57.336149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.336859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.337143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.337427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] PATH_INFO: `/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.338618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] RBAC: Authorizing `identity:get_user(user_id=55cfb5b1f26a4ec19b12e7ce5108fd60)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:57.340115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:57.341702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:58:57 2022] GET /identity/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:58:57.347459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:57.362773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:58:57.424172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b867cd8-d78f-4a4c-bc05-0e19e677e8c5 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:57.448458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2399-7c1b-487d-804b-e3b9a0729d9c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:57.457358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.458210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.458490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.458798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.477018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:57.479268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:57.483149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.483793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.484078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.484359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.485511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:57.486979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:57.488781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:58:57.495096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:58:57.497526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:58:57.498354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:58:57.499296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:58:57.499296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:58:57.499296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:58:57.499296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:58:57.504260 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:58:57.562900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:58:57.575875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:58:57.595374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814b76-797d-4754-b7e4-d253e595780b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:57.607022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f6566-fa70-437b-b92d-8fb22157a476 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:58:57.629486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc6e3-b7d1-492c-9744-8841a8774646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.630104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc6e3-b7d1-492c-9744-8841a8774646 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.630393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc6e3-b7d1-492c-9744-8841a8774646 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.630701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc6e3-b7d1-492c-9744-8841a8774646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.631432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc6e3-b7d1-492c-9744-8841a8774646 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.domain.id=default, user.id=55cfb5b1f26a4ec19b12e7ce5108fd60) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:58:57.631746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc6e3-b7d1-492c-9744-8841a8774646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:57.633201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc6e3-b7d1-492c-9744-8841a8774646 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:57.640501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 17 19:58:57 2022] GET /identity/v3/role_assignments?user.id=55cfb5b1f26a4ec19b12e7ce5108fd60&scope.domain.id=default&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:58:57.641512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3efab-acfd-4bfc-8038-9159ff1645c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:58:57.642133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3efab-acfd-4bfc-8038-9159ff1645c8 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:57.642417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3efab-acfd-4bfc-8038-9159ff1645c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:57.642726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3efab-acfd-4bfc-8038-9159ff1645c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:57.643381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3efab-acfd-4bfc-8038-9159ff1645c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:58:57.643690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3efab-acfd-4bfc-8038-9159ff1645c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:58:57.645142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3efab-acfd-4bfc-8038-9159ff1645c8 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:58:57.666093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 19:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:58:59.794716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6edb2-dff1-46f4-bb90-6004e1a0958c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:59.795239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6edb2-dff1-46f4-bb90-6004e1a0958c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:59.795320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6edb2-dff1-46f4-bb90-6004e1a0958c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:59.796911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:58:59.804187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf2fa8-0e1c-4288-9c21-cb56aaf4df2a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:59.805063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf2fa8-0e1c-4288-9c21-cb56aaf4df2a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:59.805789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf2fa8-0e1c-4288-9c21-cb56aaf4df2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:59.835713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-96cf2fa8-0e1c-4288-9c21-cb56aaf4df2a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:58:59.837904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-96cf2fa8-0e1c-4288-9c21-cb56aaf4df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:58:59.899671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90daed-362e-4211-88eb-1a5f3c92dfa3 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:59.900465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90daed-362e-4211-88eb-1a5f3c92dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:59.900961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90daed-362e-4211-88eb-1a5f3c92dfa3 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:59.902826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 13/23] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:58:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:58:59.908414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5421d1-c40d-42c6-8392-f2050275bd67 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:59.908968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5421d1-c40d-42c6-8392-f2050275bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:59.909435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5421d1-c40d-42c6-8392-f2050275bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:59.942061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dc5421d1-c40d-42c6-8392-f2050275bd67 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:58:59.944997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dc5421d1-c40d-42c6-8392-f2050275bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:58:59.950486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 11/24] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:00.034621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 14/25] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:00.331170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4dc6-26d3-42d7-8a7d-0af4407a161d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:00.331906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4dc6-26d3-42d7-8a7d-0af4407a161d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:00.332569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4dc6-26d3-42d7-8a7d-0af4407a161d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:00.334519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 12/26] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:00.335765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5421d1-c40d-42c6-8392-f2050275bd67 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:00.341029 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bb70d-fe50-41ca-a5e0-a87824fda5dc None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:00.341312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bb70d-fe50-41ca-a5e0-a87824fda5dc None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:00.341824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bb70d-fe50-41ca-a5e0-a87824fda5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:00.368273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-904bb70d-fe50-41ca-a5e0-a87824fda5dc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:00.369702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-904bb70d-fe50-41ca-a5e0-a87824fda5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:00.424242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:00.447419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:00.467105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5421d1-c40d-42c6-8392-f2050275bd67 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:00.502892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:00.525106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:00.525795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:00.526085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:00.526368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:00.543950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:00.545477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:00.551070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bb70d-fe50-41ca-a5e0-a87824fda5dc None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:59:00.563485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:00.564401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:59:00.565259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:59:00.565259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:59:00.565259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:00.565259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 15/28] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:00.573912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:00.696574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8d83-1349-4bb6-953f-d8642838c5cb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:00.743230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:00.769640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c8c1c-4a5e-4794-9759-e51e806f8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:00.770657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8c1c-4a5e-4794-9759-e51e806f8066 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:00.771148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8c1c-4a5e-4794-9759-e51e806f8066 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:00.771650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8c1c-4a5e-4794-9759-e51e806f8066 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:00.772637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8c1c-4a5e-4794-9759-e51e806f8066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:00.773186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8c1c-4a5e-4794-9759-e51e806f8066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:00.776974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8c1c-4a5e-4794-9759-e51e806f8066 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:00.787959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bb70d-fe50-41ca-a5e0-a87824fda5dc None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:00.812936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 16/29] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:00.814399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53069967-5cec-4996-b069-9d93c51096fd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:00.814728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53069967-5cec-4996-b069-9d93c51096fd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:00.815013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53069967-5cec-4996-b069-9d93c51096fd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:00.816267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 17/30] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:00.823088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a346-6748-462a-a8c5-146a2a57dd5e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:00.823743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a346-6748-462a-a8c5-146a2a57dd5e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:00.824179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a346-6748-462a-a8c5-146a2a57dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:00.854076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-efd8a346-6748-462a-a8c5-146a2a57dd5e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:00.855478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-efd8a346-6748-462a-a8c5-146a2a57dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:00.859378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:00.860045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:00.860337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:00.860613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:00.883764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:00.890428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:00.891320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:00.892059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 14/31] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:00.892663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:00.952958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:00.975175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 18/32] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:00.976887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8a346-6748-462a-a8c5-146a2a57dd5e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:01.035875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd7db-e9d4-498b-af3d-0bb78105bf5c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:01.075280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:01.076308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.076811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.077339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.078405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:01.080087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:01.165812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8a346-6748-462a-a8c5-146a2a57dd5e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:01.185495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:01.205324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:01.206270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.206757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.207259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.208107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:01.208611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:01.222492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:01.240582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 19/33] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:01.241729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:01.360133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf582-ea16-48f4-aca2-c4f9598e4451 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:01.366998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 15/34] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 19:59:00 2022] POST /identity/v3/projects => generated 301 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:01.368883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:01.404348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a204a9-55b4-4c4c-b680-d3c692062154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:01.405479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a204a9-55b4-4c4c-b680-d3c692062154 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.406101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a204a9-55b4-4c4c-b680-d3c692062154 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.406459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a204a9-55b4-4c4c-b680-d3c692062154 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.407527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a204a9-55b4-4c4c-b680-d3c692062154 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:01.409295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a204a9-55b4-4c4c-b680-d3c692062154 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:01.489953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:01.504713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6037-3d0b-4d0d-966b-04816713cfff None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:01.545064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:01.545733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.546031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.546362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] PATH_INFO: `/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.548035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] RBAC: Authorizing `identity:get_user(user_id=55cfb5b1f26a4ec19b12e7ce5108fd60)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:01.549682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:01.551351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 16/35] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:01 2022] GET /identity/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:01.552107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:01.655236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 20/36] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 17 19:59:01 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:01.664665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c8e0f-a191-425d-8d32-4802fc69e4fa None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.664994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c8e0f-a191-425d-8d32-4802fc69e4fa None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.665235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c8e0f-a191-425d-8d32-4802fc69e4fa None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.666837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 21/37] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:01.667572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c8e0f-a191-425d-8d32-4802fc69e4fa None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:01.671939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252fda3-df5f-4049-a7ea-11e21091babd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:01.716686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c4b27-cc60-4d5a-ada7-b0633d3109c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:01.717782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c4b27-cc60-4d5a-ada7-b0633d3109c0 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.718278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c4b27-cc60-4d5a-ada7-b0633d3109c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.718803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c4b27-cc60-4d5a-ada7-b0633d3109c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.719753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c4b27-cc60-4d5a-ada7-b0633d3109c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:01.721415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:01.722617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c4b27-cc60-4d5a-ada7-b0633d3109c0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:01.791732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c8e0f-a191-425d-8d32-4802fc69e4fa None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:01.813122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 17/38] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 17 19:59:01 2022] POST /identity/v3/roles => generated 225 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:01.815440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bf699-33df-475c-85cd-ca721e1151b9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.816092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bf699-33df-475c-85cd-ca721e1151b9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.816565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bf699-33df-475c-85cd-ca721e1151b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.835295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dd42c-1c93-4033-b1e5-9fa0590f6bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:01.837953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd42c-1c93-4033-b1e5-9fa0590f6bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.837953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd42c-1c93-4033-b1e5-9fa0590f6bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.837953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd42c-1c93-4033-b1e5-9fa0590f6bf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.838274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dd42c-1c93-4033-b1e5-9fa0590f6bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:01.839746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dd42c-1c93-4033-b1e5-9fa0590f6bf0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:01.841708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 22/39] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:01.842807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f02d1e-c640-4d15-8274-1d9e94f200cd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.843054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f02d1e-c640-4d15-8274-1d9e94f200cd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.843291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f02d1e-c640-4d15-8274-1d9e94f200cd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.845068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 23/40] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:01.849777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-cd5bf699-33df-475c-85cd-ca721e1151b9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:01.850574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a5d1-b0f7-4a29-ab79-d04cbb2e5667 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:01.850908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a5d1-b0f7-4a29-ab79-d04cbb2e5667 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:01.851194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a5d1-b0f7-4a29-ab79-d04cbb2e5667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:01.853679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-cd5bf699-33df-475c-85cd-ca721e1151b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:01.869098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:01.878999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9347a5d1-b0f7-4a29-ab79-d04cbb2e5667 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:01.882781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9347a5d1-b0f7-4a29-ab79-d04cbb2e5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:01.959966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 18/41] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:01.961078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bf699-33df-475c-85cd-ca721e1151b9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:01.975382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 24/42] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:02.072331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bf699-33df-475c-85cd-ca721e1151b9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:02.109051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:02.109730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:02.110021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:02.110303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] PATH_INFO: `/v3/domains/default/users/55cfb5b1f26a4ec19b12e7ce5108fd60/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:02.112355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=55cfb5b1f26a4ec19b12e7ce5108fd60, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:02.113838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:02.217978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 19/43] 10.222.0.64 () {58 vars in 1361 bytes} [Wed Aug 17 19:59:01 2022] PUT /identity/v3/domains/default/users/55cfb5b1f26a4ec19b12e7ce5108fd60/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:02.231590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347a5d1-b0f7-4a29-ab79-d04cbb2e5667 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:02.246890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:02.259369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:02.278224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:02.362436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347a5d1-b0f7-4a29-ab79-d04cbb2e5667 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:02.395160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bf7eb-ce67-4fcd-b0e7-e287531ad290 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:02.435232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:02.435875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:02.436165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:02.436450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:02.437633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:02.440572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:02.442288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 20/44] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:02.448241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:02.511206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73d6f-0b6c-44ce-b7b2-dbf062247518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:02.511830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73d6f-0b6c-44ce-b7b2-dbf062247518 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:02.512122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73d6f-0b6c-44ce-b7b2-dbf062247518 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:02.512406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73d6f-0b6c-44ce-b7b2-dbf062247518 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:02.513074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c73d6f-0b6c-44ce-b7b2-dbf062247518 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:02.514474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c73d6f-0b6c-44ce-b7b2-dbf062247518 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:02.532041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:02.556971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557f322-ed86-4dab-b3c0-22516f8bb4ae None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:02.591942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14892455-fb87-430d-9424-c4abf5e4a4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:02.592768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14892455-fb87-430d-9424-c4abf5e4a4eb None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:02.593057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14892455-fb87-430d-9424-c4abf5e4a4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:02.593336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14892455-fb87-430d-9424-c4abf5e4a4eb None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:02.594130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14892455-fb87-430d-9424-c4abf5e4a4eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:02.595324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 25/45] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 17 19:59:02 2022] POST /identity/v3/roles => generated 223 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:02.595990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14892455-fb87-430d-9424-c4abf5e4a4eb None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:02.690667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 21/46] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 19:59:02 2022] POST /identity/v3/projects => generated 312 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:04.245166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb53d-7a97-4a5d-b84d-98749467a205 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:04.245695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb53d-7a97-4a5d-b84d-98749467a205 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:04.245695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb53d-7a97-4a5d-b84d-98749467a205 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:04.247161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 26/47] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:04.252960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510cda5-32c1-4671-9bb9-8bed9038ddc4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:04.253489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510cda5-32c1-4671-9bb9-8bed9038ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:04.253620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510cda5-32c1-4671-9bb9-8bed9038ddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:04.275377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c510cda5-32c1-4671-9bb9-8bed9038ddc4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:04.283376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c510cda5-32c1-4671-9bb9-8bed9038ddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:04.457396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:04.654246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fea36-a711-4fb5-b543-1c8fb4ab8a5f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:04.654533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fea36-a711-4fb5-b543-1c8fb4ab8a5f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:04.654848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fea36-a711-4fb5-b543-1c8fb4ab8a5f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:04.656587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 27/49] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:04.661580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb72b-0c18-42eb-8594-fe71f2dc0a83 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:04.661878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb72b-0c18-42eb-8594-fe71f2dc0a83 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:04.662160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb72b-0c18-42eb-8594-fe71f2dc0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:04.681776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e2dfb72b-0c18-42eb-8594-fe71f2dc0a83 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:04.683042 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e2dfb72b-0c18-42eb-8594-fe71f2dc0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:04.729126 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fea36-a711-4fb5-b543-1c8fb4ab8a5f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:04.733548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:04.751097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 23/50] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:04.827770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:04.834399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fea36-a711-4fb5-b543-1c8fb4ab8a5f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:04.869498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:04.870133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:04.870423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:04.870737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:04.881609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:04.886992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:04.887822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:04.888552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 28/51] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:04.894158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfb72b-0c18-42eb-8594-fe71f2dc0a83 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:04.993467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfb72b-0c18-42eb-8594-fe71f2dc0a83 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:05.022464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:05.026210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:05.026863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:05.027156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:05.027434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:05.028116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:05.028428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:05.029819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:05.042512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 24/52] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:05.048023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:05.097724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:05.127629 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e870ae1-4f39-41e0-87cf-adde64bbc88b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:05.152540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f57bb-6ade-41c7-aef8-6a387558ce75 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:05.162521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:05.163195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:05.163480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:05.163762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:05.165442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:05.166950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:05.168554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 29/53] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:05.174173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:05.188012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:05.188661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:05.188948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:05.189259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] PATH_INFO: `/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:05.190417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] RBAC: Authorizing `identity:get_user(user_id=55cfb5b1f26a4ec19b12e7ce5108fd60)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:05.191948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:05.193538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 25/54] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:05 2022] GET /identity/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:05.199258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:05.199776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:05.279098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92e6a-c394-43d6-a663-4b54f35149d6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:05.303922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2f596-cbe0-4f77-811b-ef9bc91380b4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:05.315953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd039-bd77-4966-b3ee-4b1eac24ce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:05.316578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd039-bd77-4966-b3ee-4b1eac24ce5c None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:05.316865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd039-bd77-4966-b3ee-4b1eac24ce5c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:05.317147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd039-bd77-4966-b3ee-4b1eac24ce5c None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:05.317806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd039-bd77-4966-b3ee-4b1eac24ce5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:05.319330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd039-bd77-4966-b3ee-4b1eac24ce5c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:05.321766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:05.341513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:05.342180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:05.342477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:05.342796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:05.344083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:05.345650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:05.347270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 26/55] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:05.354061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:05.421570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 30/56] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 17 19:59:05 2022] POST /identity/v3/projects => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:05.458278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6282-e7ab-4cf8-9cf2-c8c531e63885 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:05.496124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8e6f-f8ba-4f17-8053-cd7338245259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:05.496767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8e6f-f8ba-4f17-8053-cd7338245259 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:05.497055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8e6f-f8ba-4f17-8053-cd7338245259 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:05.497336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8e6f-f8ba-4f17-8053-cd7338245259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:05.498138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb8e6f-f8ba-4f17-8053-cd7338245259 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.domain.id=default, user.id=55cfb5b1f26a4ec19b12e7ce5108fd60) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:05.498455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb8e6f-f8ba-4f17-8053-cd7338245259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:05.499995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb8e6f-f8ba-4f17-8053-cd7338245259 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:05.508825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 27/57] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 17 19:59:05 2022] GET /identity/v3/role_assignments?user.id=55cfb5b1f26a4ec19b12e7ce5108fd60&scope.domain.id=default&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:07.364025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5cac2-416a-40e4-888a-671d9c2a8300 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:07.364559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5cac2-416a-40e4-888a-671d9c2a8300 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:07.364647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5cac2-416a-40e4-888a-671d9c2a8300 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:07.365937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 31/58] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:07.371454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76b91-5975-46d9-a1a5-19316824b15a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:07.371849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76b91-5975-46d9-a1a5-19316824b15a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:07.372023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76b91-5975-46d9-a1a5-19316824b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:07.390240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9aa76b91-5975-46d9-a1a5-19316824b15a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:07.391464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9aa76b91-5975-46d9-a1a5-19316824b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:07.433864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:07.456417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 28/59] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:07.724112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5cac2-416a-40e4-888a-671d9c2a8300 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:07.804056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:07.828522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5cac2-416a-40e4-888a-671d9c2a8300 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:07.861788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2ce01-a537-41bc-975e-6cb340df7d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:07.862408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ce01-a537-41bc-975e-6cb340df7d1a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:07.862715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ce01-a537-41bc-975e-6cb340df7d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:07.862995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ce01-a537-41bc-975e-6cb340df7d1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:07.864104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2ce01-a537-41bc-975e-6cb340df7d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:07.865554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2ce01-a537-41bc-975e-6cb340df7d1a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:07.867152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 32/60] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:07.873358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76b91-5975-46d9-a1a5-19316824b15a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:07.972337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76b91-5975-46d9-a1a5-19316824b15a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:08.006615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fb92e-8215-4c29-b854-d52c8ef0bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:08.007252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb92e-8215-4c29-b854-d52c8ef0bf93 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:08.007543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb92e-8215-4c29-b854-d52c8ef0bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:08.007823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb92e-8215-4c29-b854-d52c8ef0bf93 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:08.008849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fb92e-8215-4c29-b854-d52c8ef0bf93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:08.010314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fb92e-8215-4c29-b854-d52c8ef0bf93 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:08.131227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 29/61] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:07 2022] POST /identity/v3/users => generated 275 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:11.713342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc2d15-92c7-47bd-8429-fbf29965952e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:11.714834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc2d15-92c7-47bd-8429-fbf29965952e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:11.715607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc2d15-92c7-47bd-8429-fbf29965952e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:11.718340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 33/62] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:11.724992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dcf52-8e6a-41ae-8674-9fe6163bbb66 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:11.726390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dcf52-8e6a-41ae-8674-9fe6163bbb66 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:11.727768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dcf52-8e6a-41ae-8674-9fe6163bbb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:11.767640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-707dcf52-8e6a-41ae-8674-9fe6163bbb66 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:11.770069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-707dcf52-8e6a-41ae-8674-9fe6163bbb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:11.810867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:11.824364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0453a9-6103-44f1-a761-fb63818b5bb7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:11.824750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0453a9-6103-44f1-a761-fb63818b5bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:11.825021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0453a9-6103-44f1-a761-fb63818b5bb7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:11.826283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 34/63] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:11.833623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d350d0-b657-4316-a1e5-f55cdc733b52 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:11.833623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d350d0-b657-4316-a1e5-f55cdc733b52 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:11.833623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d350d0-b657-4316-a1e5-f55cdc733b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:11.870781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-33d350d0-b657-4316-a1e5-f55cdc733b52 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:11.872045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33d350d0-b657-4316-a1e5-f55cdc733b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:11.887249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 30/64] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:11.932606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febb207-6ec9-40e0-9410-bf8e64e77cec None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:11.933196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febb207-6ec9-40e0-9410-bf8e64e77cec None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:11.933671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febb207-6ec9-40e0-9410-bf8e64e77cec None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:11.935549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 31/65] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:11.941030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b0a5-9314-44fb-92ea-68d2fe7c94d1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:11.941607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b0a5-9314-44fb-92ea-68d2fe7c94d1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:11.942084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b0a5-9314-44fb-92ea-68d2fe7c94d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:11.975779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6405b0a5-9314-44fb-92ea-68d2fe7c94d1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:11.979592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6405b0a5-9314-44fb-92ea-68d2fe7c94d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:12.002333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 35/66] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:12.091987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 32/67] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:12.139074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7f063-1dbf-4b18-98c8-043ee119cd27 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.139685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7f063-1dbf-4b18-98c8-043ee119cd27 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.140181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7f063-1dbf-4b18-98c8-043ee119cd27 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.141750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 36/68] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:12.150683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e2ff-5169-4dfa-ae4f-77d15597b94f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.151283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e2ff-5169-4dfa-ae4f-77d15597b94f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.151756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e2ff-5169-4dfa-ae4f-77d15597b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.183788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3465e2ff-5169-4dfa-ae4f-77d15597b94f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:12.185337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3465e2ff-5169-4dfa-ae4f-77d15597b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:12.205732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7f063-1dbf-4b18-98c8-043ee119cd27 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:12.321591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 33/69] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:12.323379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e2ff-5169-4dfa-ae4f-77d15597b94f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:12.342173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:12.368056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:12.391201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7f063-1dbf-4b18-98c8-043ee119cd27 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:12.442385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef703b3-211e-4472-9f4a-b621eaa6b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:12.442990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef703b3-211e-4472-9f4a-b621eaa6b22b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.443278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef703b3-211e-4472-9f4a-b621eaa6b22b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.443554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef703b3-211e-4472-9f4a-b621eaa6b22b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.450895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e2ff-5169-4dfa-ae4f-77d15597b94f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:12.465192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef703b3-211e-4472-9f4a-b621eaa6b22b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-eef703b3-211e-4472-9f4a-b621eaa6b22b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:12.471019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:12.471942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:12.472663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 37/70] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:12.474364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dbaf6-a390-4687-bffe-6ff8dd2555e0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.474669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dbaf6-a390-4687-bffe-6ff8dd2555e0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.474957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dbaf6-a390-4687-bffe-6ff8dd2555e0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.476364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 38/71] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:12.484708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dbaf6-a390-4687-bffe-6ff8dd2555e0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:12.494616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151eaa-5ff6-4902-8a6b-26e1346bb803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:12.495344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151eaa-5ff6-4902-8a6b-26e1346bb803 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.495628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151eaa-5ff6-4902-8a6b-26e1346bb803 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.495906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151eaa-5ff6-4902-8a6b-26e1346bb803 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.507498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151eaa-5ff6-4902-8a6b-26e1346bb803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-9b151eaa-5ff6-4902-8a6b-26e1346bb803 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:12.512951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:12.513822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 34/72] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:12.519361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6236c6a-8d7a-4ebb-ac03-f3ca27a9270d None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.521281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6236c6a-8d7a-4ebb-ac03-f3ca27a9270d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.521281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6236c6a-8d7a-4ebb-ac03-f3ca27a9270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.537992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b6236c6a-8d7a-4ebb-ac03-f3ca27a9270d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:12.539478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b6236c6a-8d7a-4ebb-ac03-f3ca27a9270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:12.610578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 35/73] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:12.611775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6236c6a-8d7a-4ebb-ac03-f3ca27a9270d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:12.618918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dbaf6-a390-4687-bffe-6ff8dd2555e0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:12.635659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:12.693249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:12.694119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.694540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.695205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.696610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:12.697258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:12.698869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:12.706997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:12.710332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 39/74] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:12.712026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:12.791243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6236c6a-8d7a-4ebb-ac03-f3ca27a9270d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:12.824867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0967b-5716-447e-a0f9-ca1353bdcbc8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:12.851020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:12.852655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.853162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.853672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.855083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:12.855638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:12.858199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:12.863153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:12.864013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.864495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.865003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.873232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 36/75] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:12.874832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:12.881445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:12.887426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:12.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:12.889304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:12.891432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 40/76] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:12.892374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:12.963024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:12.972914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:12.998465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730e72d-e4a4-45d2-959a-67d688f199a4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.014034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a785ed-cc12-4a51-92f6-142ed600b91e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.036944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.037612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.038372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.038677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.052433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.053071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.053353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.053630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.057740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.059400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.061490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 37/77] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:12 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:13.063545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.066686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:13.074778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:13.076263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:13.077267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 41/78] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:13.079386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.178349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1b1c-5c38-4eba-b4e7-3af9b9776739 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.194475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f3168-9696-46cd-854b-9c4de675895a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.212395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:13.216161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.216862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.217209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.217604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.218997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.220637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.222319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 38/79] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:13.223139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.226243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:13.237037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.237674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.237956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.238237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.238951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:13.239333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.241010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.251891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 42/80] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:13.254031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.349859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263ad17-e998-4425-96c5-58edc32712b7 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.391939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f885752-2db2-43e5-ae3c-18ee65cc8c50 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.400921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.401689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.402057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.402415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.403759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.405718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.407489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 39/81] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:13.408499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.442852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.443836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.444185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.444611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.513681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:13.516972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:13.549151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.551636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.566587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc0f77-b016-460c-aec6-1f7b7cea7e35 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.609523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.610218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.610544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.610970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.611726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:13.612193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.613914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.624789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 40/82] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:13.627617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.687690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 43/83] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:13.688612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.777570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:13.784403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876bfd-c5a7-4a2d-8bed-de70777fb34f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.803245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d8e1f-e8e7-4cba-a19d-140781e9c149 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:13.819425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:13.826133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.828750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.828750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.828750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.857394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:13.858506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.859065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.859573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] PATH_INFO: `/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.861670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] RBAC: Authorizing `identity:get_user(user_id=55cfb5b1f26a4ec19b12e7ce5108fd60)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.864528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.868422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 44/84] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:13.869852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.926984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:13.930460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:13.991180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30c9b-9bcf-4eb8-bfaf-378c4e7bf75d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.041719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.042592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.043088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.043489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.044514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.047059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.073894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 41/85] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:14.074783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.109509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.182909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 45/86] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:13 2022] POST /identity/v3/users => generated 289 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:14.194931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.195072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8a6f-1e54-4966-a6dd-4ebac27aa814 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.195198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.239709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.240676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.241073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.241557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.243963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.245978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.248645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 42/87] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:14.249652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.357798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e776a5e-ce2e-4c03-b729-04b6664f2d80 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.423478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.424154 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.424512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.424859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.426280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.428982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.431542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 46/88] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:14.432735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.442551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.447345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4a9cc-790d-4fbc-a69b-3fd79460f46c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.496297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.496935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.497245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.497499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.574844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.642090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.642090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.649204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343daf5-32a2-4af6-9114-8ca2fc735f62 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.692712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.693547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.693971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.694379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.696847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.699712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.703249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 47/89] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:14.706769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.829299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.834687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb982-acf2-4b65-9be2-33583e942898 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.839749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 43/90] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:14.840549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.899705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.900744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.901062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.901408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.913426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.004444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.006009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.028437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347333d-25d9-461a-9505-3c6f20029946 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.098086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.100342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.101129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.103868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.106227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=37aa59325ec5426a8f56e75d1c2bbad3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:15.107140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.111413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.126470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 44/91] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/role_assignments?user.id=37aa59325ec5426a8f56e75d1c2bbad3&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.128533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.283494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 48/92] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:15.284807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.377609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.411232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.504034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf586d7-ca14-4239-bf6e-ebdf0da67bb2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.531521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870765e0-a58b-4c1a-a3ac-bbe8d6e15884 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.566864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.567437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.567728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.568012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.569331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] RBAC: Adding query filter params (role.id=341040ab922c4a298485eb1262890305, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=37aa59325ec5426a8f56e75d1c2bbad3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:15.569642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.572170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.579662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 45/93] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/role_assignments?user.id=37aa59325ec5426a8f56e75d1c2bbad3&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=341040ab922c4a298485eb1262890305 => generated 259 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.580598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.655783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.656796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.657239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.657664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.661127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.662987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.676096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 49/94] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.677516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.868321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb10d8-0f50-4f7b-9e68-f03c37870255 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.928238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a8014-6f78-435c-8fb2-59ef81289d5c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.938224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.941858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.966351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.967389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.967863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.968357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] PATH_INFO: `/v3/projects/3ba741fbf80740f78e4937a796e36314` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.969946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] RBAC: Authorizing `identity:get_project(project_id=3ba741fbf80740f78e4937a796e36314)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.971841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.971988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f5afe-a271-4786-a7e6-42ba7fdecbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.972590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f5afe-a271-4786-a7e6-42ba7fdecbca None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.972879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f5afe-a271-4786-a7e6-42ba7fdecbca None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.973159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f5afe-a271-4786-a7e6-42ba7fdecbca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.973921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f5afe-a271-4786-a7e6-42ba7fdecbca None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=55cfb5b1f26a4ec19b12e7ce5108fd60) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:15.974231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f5afe-a271-4786-a7e6-42ba7fdecbca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.976019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f5afe-a271-4786-a7e6-42ba7fdecbca None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.979192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 46/95] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/projects/3ba741fbf80740f78e4937a796e36314 => generated 312 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.983440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 50/96] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/role_assignments?user.id=55cfb5b1f26a4ec19b12e7ce5108fd60&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.992166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:16.156430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c18f-d438-4de5-823d-f52b1723674e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:16.197416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ec09-205a-4989-a9f1-d8ebbce8dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:16.198053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ec09-205a-4989-a9f1-d8ebbce8dc78 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:16.198606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ec09-205a-4989-a9f1-d8ebbce8dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:16.198982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ec09-205a-4989-a9f1-d8ebbce8dc78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:16.199799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377ec09-205a-4989-a9f1-d8ebbce8dc78 None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=3ba741fbf80740f78e4937a796e36314, user.id=37aa59325ec5426a8f56e75d1c2bbad3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:16.200188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377ec09-205a-4989-a9f1-d8ebbce8dc78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:16.201928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377ec09-205a-4989-a9f1-d8ebbce8dc78 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:16.208349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 47/97] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/role_assignments?user.id=37aa59325ec5426a8f56e75d1c2bbad3&scope.project.id=3ba741fbf80740f78e4937a796e36314&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:17.008946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6e4fa-a275-43fb-9c3e-9700e33684bd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:17.009437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6e4fa-a275-43fb-9c3e-9700e33684bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:17.009437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6e4fa-a275-43fb-9c3e-9700e33684bd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:17.010912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 51/98] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:17.016705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec4ee7-9f80-4dee-98bb-dd9f57793050 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:17.017667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec4ee7-9f80-4dee-98bb-dd9f57793050 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:17.018296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec4ee7-9f80-4dee-98bb-dd9f57793050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:17.022349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d60076-8be8-45aa-9cd7-b1390baf5252 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:17.022706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d60076-8be8-45aa-9cd7-b1390baf5252 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:17.022990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d60076-8be8-45aa-9cd7-b1390baf5252 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:17.028339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 52/99] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:17.029587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7230b-3fbb-420d-9aad-831856c6a46e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:17.029872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7230b-3fbb-420d-9aad-831856c6a46e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:17.030149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7230b-3fbb-420d-9aad-831856c6a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:17.054607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0aec4ee7-9f80-4dee-98bb-dd9f57793050 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:17.056428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0aec4ee7-9f80-4dee-98bb-dd9f57793050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:17.068864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-17a7230b-3fbb-420d-9aad-831856c6a46e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:17.070059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-17a7230b-3fbb-420d-9aad-831856c6a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:17.167015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:17.184418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 48/100] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:17.198264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 53/101] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:17.512734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec4ee7-9f80-4dee-98bb-dd9f57793050 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:17.631435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec4ee7-9f80-4dee-98bb-dd9f57793050 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:17.684391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:17.685050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:17.685335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:17.685608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:17.686760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:17.688348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:17.690968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 49/102] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:17.696273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7230b-3fbb-420d-9aad-831856c6a46e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:17.776310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:17.830294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:17.833502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7230b-3fbb-420d-9aad-831856c6a46e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:17.870978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:17.905579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:17.906305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:17.906602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:17.906903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:17.907574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:17.910827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:17.950563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077431f3-bae8-483e-89cd-d62e06aed976 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:18.002038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:18.002785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.003064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.003338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.013343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 54/103] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 19:59:17 2022] POST /identity/v3/projects => generated 302 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:18.031462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:18.045491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:18.046466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:18.047296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 50/104] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:18.052877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:18.194073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dd4ac-7996-4480-b15c-dd3e272e3f32 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:18.239797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb12d-de8e-4cf3-a0a4-14ecae421230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:18.240429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb12d-de8e-4cf3-a0a4-14ecae421230 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.240714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb12d-de8e-4cf3-a0a4-14ecae421230 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.240990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb12d-de8e-4cf3-a0a4-14ecae421230 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.241667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb12d-de8e-4cf3-a0a4-14ecae421230 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:18.241971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb12d-de8e-4cf3-a0a4-14ecae421230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:18.244118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb12d-de8e-4cf3-a0a4-14ecae421230 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:18.259229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 55/105] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:18.264904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:18.319706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c798b4-d19c-42e9-9c95-ec107276018b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.319984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c798b4-d19c-42e9-9c95-ec107276018b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.320815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c798b4-d19c-42e9-9c95-ec107276018b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.322554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 56/106] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:18.328268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01753-b526-4b41-bc48-7ba19248ceac None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.328573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01753-b526-4b41-bc48-7ba19248ceac None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.328883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01753-b526-4b41-bc48-7ba19248ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.353523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cfe01753-b526-4b41-bc48-7ba19248ceac None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:18.354851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cfe01753-b526-4b41-bc48-7ba19248ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:18.384843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:18.487747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 57/107] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:18.502286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb08d-2c59-4186-aecd-4489ab797c69 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:18.526791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:18.547625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:18.548275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.548559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.548836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] PATH_INFO: `/v3/users/28641c1b7a644deea433172208ef7910` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.571538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] RBAC: Authorizing `identity:get_user(user_id=28641c1b7a644deea433172208ef7910)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:18.572988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:18.574902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 51/108] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:18 2022] GET /identity/v3/users/28641c1b7a644deea433172208ef7910 => generated 289 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:18.580721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe01753-b526-4b41-bc48-7ba19248ceac None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:18.722671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe01753-b526-4b41-bc48-7ba19248ceac None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:18.775740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4670e94-d3b1-4fd0-a575-7c5e67a6b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:18.776372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4670e94-d3b1-4fd0-a575-7c5e67a6b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.776663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4670e94-d3b1-4fd0-a575-7c5e67a6b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.776943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4670e94-d3b1-4fd0-a575-7c5e67a6b3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.807170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:18.887380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:18.889205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4670e94-d3b1-4fd0-a575-7c5e67a6b3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:18.890713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4670e94-d3b1-4fd0-a575-7c5e67a6b3d2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.021853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 58/109] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:19.023247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ace5-115a-4904-81fb-779f341a2a9d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.023755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ace5-115a-4904-81fb-779f341a2a9d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.024214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ace5-115a-4904-81fb-779f341a2a9d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.025733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 59/110] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:19.029621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907ace5-115a-4904-81fb-779f341a2a9d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.078359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b79ed-44a9-43b7-a61a-9ba8904299d8 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.127157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.137165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377e31e-0cd9-4af8-ab20-8eb887e3f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.138174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377e31e-0cd9-4af8-ab20-8eb887e3f2fc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.138690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377e31e-0cd9-4af8-ab20-8eb887e3f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.139140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377e31e-0cd9-4af8-ab20-8eb887e3f2fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.152878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377e31e-0cd9-4af8-ab20-8eb887e3f2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-b377e31e-0cd9-4af8-ab20-8eb887e3f2fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:19.158458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:19.159468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:19.160297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:19.162296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 52/111] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:19.165110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73124730-76e0-417d-9235-003685207421 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.165847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73124730-76e0-417d-9235-003685207421 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.166280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73124730-76e0-417d-9235-003685207421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.191350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-73124730-76e0-417d-9235-003685207421 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:19.192936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-73124730-76e0-417d-9235-003685207421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:19.197655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907ace5-115a-4904-81fb-779f341a2a9d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.227892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.236664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5bcc8-db68-4576-a3a4-a353f481ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.240548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bcc8-db68-4576-a3a4-a353f481ed73 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.240548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bcc8-db68-4576-a3a4-a353f481ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.240548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bcc8-db68-4576-a3a4-a353f481ed73 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.240548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5bcc8-db68-4576-a3a4-a353f481ed73 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.240919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5bcc8-db68-4576-a3a4-a353f481ed73 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.243414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 60/112] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:19.244752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa99fa-320b-4437-98f3-46d7070080fb None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.245042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa99fa-320b-4437-98f3-46d7070080fb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.245398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa99fa-320b-4437-98f3-46d7070080fb None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.252606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 61/113] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:19.252606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa99fa-320b-4437-98f3-46d7070080fb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.278888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 53/114] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:19.279872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73124730-76e0-417d-9235-003685207421 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.459322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73124730-76e0-417d-9235-003685207421 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.508539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822a05d-7f9e-485c-9d83-afc8bd436355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.509226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a05d-7f9e-485c-9d83-afc8bd436355 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.509512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a05d-7f9e-485c-9d83-afc8bd436355 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.509792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a05d-7f9e-485c-9d83-afc8bd436355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.510548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a05d-7f9e-485c-9d83-afc8bd436355 None admin] RBAC: Adding query filter params (role.id=1c7e596fa48049ea87bc3896af945fa1, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=28641c1b7a644deea433172208ef7910) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:19.511091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a05d-7f9e-485c-9d83-afc8bd436355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.512386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a05d-7f9e-485c-9d83-afc8bd436355 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.520797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa99fa-320b-4437-98f3-46d7070080fb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.523062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 54/115] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/role_assignments?user.id=28641c1b7a644deea433172208ef7910&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=1c7e596fa48049ea87bc3896af945fa1 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:19.524768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723419d-38ff-454f-bf4a-98ab553e75d0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.525062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723419d-38ff-454f-bf4a-98ab553e75d0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.525345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723419d-38ff-454f-bf4a-98ab553e75d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.538822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.564040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9723419d-38ff-454f-bf4a-98ab553e75d0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:19.565384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9723419d-38ff-454f-bf4a-98ab553e75d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:19.567007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d957-2c72-4eac-a78c-02ed498d26c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.567983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d957-2c72-4eac-a78c-02ed498d26c7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.568472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d957-2c72-4eac-a78c-02ed498d26c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.569064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d957-2c72-4eac-a78c-02ed498d26c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.570234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d957-2c72-4eac-a78c-02ed498d26c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:19.571285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d957-2c72-4eac-a78c-02ed498d26c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.573019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d957-2c72-4eac-a78c-02ed498d26c7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.583617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 62/116] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:19.585290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdb14-167d-4fe9-8f1d-4ee583b423c2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.585968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdb14-167d-4fe9-8f1d-4ee583b423c2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.587879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdb14-167d-4fe9-8f1d-4ee583b423c2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.589699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 63/117] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:19.590828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cdb14-167d-4fe9-8f1d-4ee583b423c2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.602056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.689565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 55/118] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:19.691644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723419d-38ff-454f-bf4a-98ab553e75d0 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.736432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cdb14-167d-4fe9-8f1d-4ee583b423c2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.807045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fb9c4-4b5f-4af6-9c83-84a76c24b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.807712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb9c4-4b5f-4af6-9c83-84a76c24b7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.808003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb9c4-4b5f-4af6-9c83-84a76c24b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.811051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb9c4-4b5f-4af6-9c83-84a76c24b7a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.832604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fb9c4-4b5f-4af6-9c83-84a76c24b7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e05fb9c4-4b5f-4af6-9c83-84a76c24b7a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:19.845236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:19.846175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:19.846943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 64/119] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:19.847700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f157cef-fc6b-45d9-a43b-6f154d718ed3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.849943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f157cef-fc6b-45d9-a43b-6f154d718ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.849943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f157cef-fc6b-45d9-a43b-6f154d718ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.869223 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723419d-38ff-454f-bf4a-98ab553e75d0 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.891595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9f157cef-fc6b-45d9-a43b-6f154d718ed3 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:19.893667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9f157cef-fc6b-45d9-a43b-6f154d718ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:19.987152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.995868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.000448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.000448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.000448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.000448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:20.005119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:20.006990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 56/120] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:20.007960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.058675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:20.076847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 65/121] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:20.077753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f157cef-fc6b-45d9-a43b-6f154d718ed3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.137021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a140d-6a15-44e4-bfe4-2ce3c2387acd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.174209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.174873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.175167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.175433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.176113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:20.176421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:20.177800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:20.187816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 57/122] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:20.189249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.310019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283608bd-0595-4eb6-a22c-d9cb630f09ae None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.310460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f157cef-fc6b-45d9-a43b-6f154d718ed3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.343065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:20.347306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.348012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.348378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.348734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.361732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:20.367848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:20.368820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:20.369558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:20.370262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 58/123] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:20.370486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.419384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.420049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.420334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.420616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.421825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:20.423327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:20.425284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 66/124] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:20.426064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.478338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:20.487660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004160d-aed1-428c-8316-121b0c4bc512 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.538224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.539802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.540139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.540540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.542174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:20.543856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:20.546203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 59/125] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:20.547061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.558417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81469e-c5b7-4ef1-ad76-6bd4f2efe87f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.572503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:20.601746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.602651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.603077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.603507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.604314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:20.604767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:20.606361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:20.616529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 67/126] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:20.617742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.694920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378fa64-968f-4259-a70b-a0c9080a2a47 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.736801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.737855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.738285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.738685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/37aa59325ec5426a8f56e75d1c2bbad3/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.740812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f43f4ccbeef34f9c9e06a711f6e66e64, user_id=37aa59325ec5426a8f56e75d1c2bbad3, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:20.741355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:20.743266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:20.747585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f084168-3da9-47ec-8172-92fe82112e10 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.781848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.782485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.782802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.783081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.794693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:20.799860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:20.800812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:20.801568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 68/127] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:20.803169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.868886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 60/128] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:20 2022] PUT /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/37aa59325ec5426a8f56e75d1c2bbad3/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:20.870014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:20.935027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1ab2-f3d6-4c08-82c5-08081a4fff40 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:20.975766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf8367-58f1-463d-82ef-b03e3f3f99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:20.977108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8367-58f1-463d-82ef-b03e3f3f99a6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.977560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8367-58f1-463d-82ef-b03e3f3f99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.977909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8367-58f1-463d-82ef-b03e3f3f99a6 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.979219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf8367-58f1-463d-82ef-b03e3f3f99a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:20.980787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf8367-58f1-463d-82ef-b03e3f3f99a6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:20.982722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 69/129] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:20.988124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:20.990007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13e2f-85fc-4644-b158-c0c130959ea9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:20.990400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13e2f-85fc-4644-b158-c0c130959ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:20.990771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13e2f-85fc-4644-b158-c0c130959ea9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:20.992597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 70/130] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:20.995556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13e2f-85fc-4644-b158-c0c130959ea9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.013675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37630b85-3827-40cf-9f78-dc8c65a3e5b7 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.026278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:21.068501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.069153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.069437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.069713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] PATH_INFO: `/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.070917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] RBAC: Authorizing `identity:get_user(user_id=55cfb5b1f26a4ec19b12e7ce5108fd60)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.072391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.074026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 61/131] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:21.076322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.131501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13e2f-85fc-4644-b158-c0c130959ea9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.182837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6083ad-7180-4a33-8522-1333125b755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.183490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6083ad-7180-4a33-8522-1333125b755b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.183777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6083ad-7180-4a33-8522-1333125b755b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.184057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6083ad-7180-4a33-8522-1333125b755b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.184990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6083ad-7180-4a33-8522-1333125b755b None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:21.185298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6083ad-7180-4a33-8522-1333125b755b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.187115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6083ad-7180-4a33-8522-1333125b755b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.201151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 71/132] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:21.206559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853ba5-e358-47c3-a821-17969e62fd59 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.206559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853ba5-e358-47c3-a821-17969e62fd59 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.206559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42853ba5-e358-47c3-a821-17969e62fd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.208491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2fd7d-9e1b-48ed-9be8-e5f93604360f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.226581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-42853ba5-e358-47c3-a821-17969e62fd59 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:21.229277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-42853ba5-e358-47c3-a821-17969e62fd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:21.248715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.249805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.250290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.250808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/37aa59325ec5426a8f56e75d1c2bbad3/roles/341040ab922c4a298485eb1262890305` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.253311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] RBAC: Authorizing `identity:create_grant(project_id=f43f4ccbeef34f9c9e06a711f6e66e64, user_id=37aa59325ec5426a8f56e75d1c2bbad3, role_id=341040ab922c4a298485eb1262890305)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.255168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.312609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 72/133] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:21.313362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853ba5-e358-47c3-a821-17969e62fd59 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.330608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:21.351646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 62/134] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:21 2022] PUT /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/37aa59325ec5426a8f56e75d1c2bbad3/roles/341040ab922c4a298485eb1262890305 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:21.359976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.370547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:21.437509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42853ba5-e358-47c3-a821-17969e62fd59 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.482410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.483439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.483921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.484466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.485914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.487637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.489766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 73/135] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:21 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:21.499733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.574101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9307b-a88d-4c02-95f9-5731c5f07f48 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.628724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.629368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.629652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.629932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.631128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.633253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.635020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 63/136] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:21 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:21.642681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.657119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:21.685904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2fb86-8b5b-4731-830c-4f1de9a779ea None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.729946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.730956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.731431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.731916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/55cfb5b1f26a4ec19b12e7ce5108fd60/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.734053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f43f4ccbeef34f9c9e06a711f6e66e64, user_id=55cfb5b1f26a4ec19b12e7ce5108fd60, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.736402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.769595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:21.807658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa093-963f-498d-9a65-c684903d16db None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.846172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107ba36-2e95-4b86-ac96-aaae3d85ab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.846955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ba36-2e95-4b86-ac96-aaae3d85ab68 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.847239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ba36-2e95-4b86-ac96-aaae3d85ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.847518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ba36-2e95-4b86-ac96-aaae3d85ab68 None admin] PATH_INFO: `/v3/projects/3ba741fbf80740f78e4937a796e36314` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.848710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107ba36-2e95-4b86-ac96-aaae3d85ab68 None admin] RBAC: Authorizing `identity:get_project(project_id=3ba741fbf80740f78e4937a796e36314)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.850292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107ba36-2e95-4b86-ac96-aaae3d85ab68 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.853067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 64/137] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:21 2022] GET /identity/v3/projects/3ba741fbf80740f78e4937a796e36314 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:21.853197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 74/138] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:21 2022] PUT /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/55cfb5b1f26a4ec19b12e7ce5108fd60/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:21.854411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.859189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d5e2-e40c-48c5-be1a-f34b2089027f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.863939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d5e2-e40c-48c5-be1a-f34b2089027f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.863939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d5e2-e40c-48c5-be1a-f34b2089027f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.863939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 65/139] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:21.864544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701d5e2-e40c-48c5-be1a-f34b2089027f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:22.034293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528f535-3abb-4099-89da-ff319dab3ab4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:22.081448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701d5e2-e40c-48c5-be1a-f34b2089027f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:22.089008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c2779-dc0b-44a1-9852-d697db652de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:22.090048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2779-dc0b-44a1-9852-d697db652de1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:22.091038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2779-dc0b-44a1-9852-d697db652de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:22.091328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2779-dc0b-44a1-9852-d697db652de1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:22.098083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c2779-dc0b-44a1-9852-d697db652de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:22.098083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c2779-dc0b-44a1-9852-d697db652de1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:22.098833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 75/140] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:22.099856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325821-2cfd-4d5e-8aba-c03071c580ea None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:22.100145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325821-2cfd-4d5e-8aba-c03071c580ea None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:22.100429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325821-2cfd-4d5e-8aba-c03071c580ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:22.120576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-79325821-2cfd-4d5e-8aba-c03071c580ea None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:22.121991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-79325821-2cfd-4d5e-8aba-c03071c580ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:22.125126 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:22.135070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:22.137573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:22.137573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:22.137573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] PATH_INFO: `/v3/projects/3ba741fbf80740f78e4937a796e36314/users/37aa59325ec5426a8f56e75d1c2bbad3/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:22.139039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] RBAC: Authorizing `identity:create_grant(project_id=3ba741fbf80740f78e4937a796e36314, user_id=37aa59325ec5426a8f56e75d1c2bbad3, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:22.140765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:22.201875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 76/141] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:22.202867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325821-2cfd-4d5e-8aba-c03071c580ea None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:22.225309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 66/142] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:21 2022] PUT /identity/v3/projects/3ba741fbf80740f78e4937a796e36314/users/37aa59325ec5426a8f56e75d1c2bbad3/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:22.346235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325821-2cfd-4d5e-8aba-c03071c580ea None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:22.389924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:22.390570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:22.390887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:22.391168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:22.391849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:22.393369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:22.406416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:22.558183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 77/143] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:22 2022] POST /identity/v3/users => generated 283 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:22.629017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:22.632011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:22.777311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1b7d1-5081-4435-9b8a-1f6f8b5f113c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:22.827353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:22.828379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:22.828862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:22.829355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:22.849298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:22.855789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:22.856672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:22.857412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:22.864092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 67/144] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:22.871841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:23.024477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ce62f-b8aa-4724-ba68-4cf451e131a1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:23.068374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:23.069015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:23.069297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:23.069745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:23.071200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:23.071739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:23.073139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:23.082889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 78/145] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:23.089122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:23.157916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:23.203024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330067-800f-4968-8853-6613a705fbb2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:23.244274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749992-5983-4449-967e-96307d144594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:23.245419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749992-5983-4449-967e-96307d144594 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:23.245769 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749992-5983-4449-967e-96307d144594 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:23.246231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749992-5983-4449-967e-96307d144594 None admin] PATH_INFO: `/v3/users/28641c1b7a644deea433172208ef7910` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:23.248222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96749992-5983-4449-967e-96307d144594 None admin] RBAC: Authorizing `identity:get_user(user_id=28641c1b7a644deea433172208ef7910)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:23.249814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96749992-5983-4449-967e-96307d144594 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:23.251731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 68/146] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:23 2022] GET /identity/v3/users/28641c1b7a644deea433172208ef7910 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:23.257011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:23.339558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:23.397281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520f4cd-bf5e-40fb-bcbd-a07d8e8904c2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:23.441105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4cee2-fab2-4ace-a43e-2cf90c153cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:23.441776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4cee2-fab2-4ace-a43e-2cf90c153cda None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:23.442128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4cee2-fab2-4ace-a43e-2cf90c153cda None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:23.442358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4cee2-fab2-4ace-a43e-2cf90c153cda None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:23.443639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4cee2-fab2-4ace-a43e-2cf90c153cda None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:23.445179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4cee2-fab2-4ace-a43e-2cf90c153cda None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:23.447264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 79/147] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:23 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:23.452830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749992-5983-4449-967e-96307d144594 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:23.609378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749992-5983-4449-967e-96307d144594 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:23.642410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:23.650138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528b26f-cff5-436b-98a8-f06e6790d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:23.650926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b26f-cff5-436b-98a8-f06e6790d14d None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:23.673480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b26f-cff5-436b-98a8-f06e6790d14d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:23.673480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528b26f-cff5-436b-98a8-f06e6790d14d None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/28641c1b7a644deea433172208ef7910/roles/1c7e596fa48049ea87bc3896af945fa1` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:23.673480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528b26f-cff5-436b-98a8-f06e6790d14d None admin] RBAC: Authorizing `identity:create_grant(project_id=f43f4ccbeef34f9c9e06a711f6e66e64, user_id=28641c1b7a644deea433172208ef7910, role_id=1c7e596fa48049ea87bc3896af945fa1)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:23.673480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528b26f-cff5-436b-98a8-f06e6790d14d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:23.768674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 69/148] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:23 2022] PUT /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/users/28641c1b7a644deea433172208ef7910/roles/1c7e596fa48049ea87bc3896af945fa1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:24.040825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4358bce-a3fb-4dd2-a4aa-4f8f73253080 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:24.041036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4358bce-a3fb-4dd2-a4aa-4f8f73253080 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:24.041441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4358bce-a3fb-4dd2-a4aa-4f8f73253080 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:24.042946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 80/149] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:24.049682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110574-2b2d-4d5b-bb68-68b09b85d752 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:24.050151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110574-2b2d-4d5b-bb68-68b09b85d752 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:24.050656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110574-2b2d-4d5b-bb68-68b09b85d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:24.091351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-32110574-2b2d-4d5b-bb68-68b09b85d752 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:24.093253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-32110574-2b2d-4d5b-bb68-68b09b85d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:24.110876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7ad57-e4c6-42a1-a65f-6919e0675555 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:24.111264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7ad57-e4c6-42a1-a65f-6919e0675555 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:24.111501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7ad57-e4c6-42a1-a65f-6919e0675555 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:24.113121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 81/150] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:24.124161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1c86-34eb-43cc-9bb3-1927a4ff6bfa None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:24.124424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1c86-34eb-43cc-9bb3-1927a4ff6bfa None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:24.124720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1c86-34eb-43cc-9bb3-1927a4ff6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:24.167774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7cfc1c86-34eb-43cc-9bb3-1927a4ff6bfa None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:24.169029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7cfc1c86-34eb-43cc-9bb3-1927a4ff6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:24.269363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 70/151] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:24.320744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 82/152] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:24.622795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32110574-2b2d-4d5b-bb68-68b09b85d752 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:24.867339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32110574-2b2d-4d5b-bb68-68b09b85d752 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:24.907333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:24.934332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:24.935421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:24.935906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:24.936393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:24.956344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:24.970849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:24.978605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:24.980096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 71/153] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:24.991671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1c86-34eb-43cc-9bb3-1927a4ff6bfa None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:25.099503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:25.163237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:25.323035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1c86-34eb-43cc-9bb3-1927a4ff6bfa None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:25.365111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e8d0-d195-4ccb-8ee6-b6490f44d7ee None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:25.434666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:25.435664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:25.436149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:25.436628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:25.456562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:25.467628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:25.468603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:25.469357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:25.470563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 72/154] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:25.471804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:25.472874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:25.473387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:25.473894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:25.475266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:25.475832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:25.478697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:25.479109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:25.513486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 83/155] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:25.522735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:25.586235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:25.721517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dda0b-a5bf-4990-9733-487892b75378 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:25.810555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:25.811604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:25.812082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:25.812529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:25.813687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:25.814216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:25.816805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:25.841266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 73/156] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:25.848043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:25.928263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c3fc4-36f4-4de5-b412-a818031167b1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:25.984923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.048753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:26.050359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.051163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.051989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.056303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:26.059675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:26.063244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 84/157] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:25 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:26.066660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dee48a-4b80-4a0f-9dc5-c2970e9dc85c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:26.066660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.073451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:26.132111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:26.133566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.133868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.134149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.139584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:26.141292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:26.143043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 74/158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:25 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:26.149549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:26.362407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fbd55-e92d-4422-be9a-5ffb0a0edfa1 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:26.473149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc5ef5-0e0a-46dc-b10c-e4cfc4933947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:26.474259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5ef5-0e0a-46dc-b10c-e4cfc4933947 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.474695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5ef5-0e0a-46dc-b10c-e4cfc4933947 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.475187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5ef5-0e0a-46dc-b10c-e4cfc4933947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.493964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2c329-8f83-434f-a8c4-82144860a51e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:26.589234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.591059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4455f-115e-4f9f-8bfe-ecb09f7e4ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:26.591992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4455f-115e-4f9f-8bfe-ecb09f7e4ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.592471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4455f-115e-4f9f-8bfe-ecb09f7e4ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.592936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4455f-115e-4f9f-8bfe-ecb09f7e4ec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.651975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc5ef5-0e0a-46dc-b10c-e4cfc4933947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:26.654645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc5ef5-0e0a-46dc-b10c-e4cfc4933947 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:26.736028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.759994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4455f-115e-4f9f-8bfe-ecb09f7e4ec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:26.761849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4455f-115e-4f9f-8bfe-ecb09f7e4ec4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:26.876964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 75/159] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:26.879529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152278-14cd-41ad-a8cd-3e06e69747a5 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.879989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152278-14cd-41ad-a8cd-3e06e69747a5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.880438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152278-14cd-41ad-a8cd-3e06e69747a5 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.883381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 76/160] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:26.885345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eabe9-4420-4f71-ba8d-21e52486ca57 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.885836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eabe9-4420-4f71-ba8d-21e52486ca57 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.886331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eabe9-4420-4f71-ba8d-21e52486ca57 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.889194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 77/161] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:26.890515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760eabe9-4420-4f71-ba8d-21e52486ca57 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.071829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 85/162] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 999 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:59:27.073572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4684e7-bd51-40b7-b31a-436c302a257b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.074074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4684e7-bd51-40b7-b31a-436c302a257b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.074569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4684e7-bd51-40b7-b31a-436c302a257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.110389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1d4684e7-bd51-40b7-b31a-436c302a257b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:27.112001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1d4684e7-bd51-40b7-b31a-436c302a257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:27.126660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.221329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760eabe9-4420-4f71-ba8d-21e52486ca57 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.245188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 86/163] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:27.246835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b3035-d932-499f-b2b4-81ce69c63454 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.247303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b3035-d932-499f-b2b4-81ce69c63454 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.247747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b3035-d932-499f-b2b4-81ce69c63454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.287781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-476b3035-d932-499f-b2b4-81ce69c63454 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:27.290185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-476b3035-d932-499f-b2b4-81ce69c63454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:27.296311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.297185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.297591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.298014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.299434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.306658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.311678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 78/164] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:26 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.311678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.316543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.469900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 87/165] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:27.471418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b3035-d932-499f-b2b4-81ce69c63454 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.611007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f38f04-b3aa-4956-a6d7-b381f9d8e0bf None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.713409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa4449-953a-4c9d-a0b1-cc318779aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.714136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4449-953a-4c9d-a0b1-cc318779aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.714421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4449-953a-4c9d-a0b1-cc318779aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.714718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4449-953a-4c9d-a0b1-cc318779aeb5 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.715921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa4449-953a-4c9d-a0b1-cc318779aeb5 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.717466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa4449-953a-4c9d-a0b1-cc318779aeb5 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.727993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 79/166] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.729115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18dd89-ad01-43bc-b468-1e6efec2d080 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.729409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18dd89-ad01-43bc-b468-1e6efec2d080 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.729687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18dd89-ad01-43bc-b468-1e6efec2d080 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.731404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 80/167] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:27.737022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20140f9-cab8-474a-b2c8-a5796d3bbb14 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.737376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20140f9-cab8-474a-b2c8-a5796d3bbb14 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.737662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20140f9-cab8-474a-b2c8-a5796d3bbb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.760381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.760619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b3035-d932-499f-b2b4-81ce69c63454 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.770404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b20140f9-cab8-474a-b2c8-a5796d3bbb14 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:27.771644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b20140f9-cab8-474a-b2c8-a5796d3bbb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:27.835219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.837067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.837357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.837724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.838481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] RBAC: Adding query filter params (role.id=341040ab922c4a298485eb1262890305, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=37aa59325ec5426a8f56e75d1c2bbad3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:27.842897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.844436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.855339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 88/168] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/role_assignments?user.id=37aa59325ec5426a8f56e75d1c2bbad3&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=341040ab922c4a298485eb1262890305 => generated 608 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.856189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.875410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.901387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 81/169] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:28.035748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5fdb6-b05c-46d7-97f2-422af41f7bbf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.086110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.086804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.087045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.087483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:28.088225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=37aa59325ec5426a8f56e75d1c2bbad3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:28.088532 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:28.089981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:28.097864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 89/170] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/role_assignments?user.id=37aa59325ec5426a8f56e75d1c2bbad3&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:28.247934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20140f9-cab8-474a-b2c8-a5796d3bbb14 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.278832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.450377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:28.535745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ccbf-e8ac-4486-baeb-a9125a9bc882 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.587317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20140f9-cab8-474a-b2c8-a5796d3bbb14 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.668955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.672501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.672501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.672501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:28.707411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.708339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.708798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.709248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:28.716504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:28.718949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:28.726531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:28.737980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:28.738793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 90/171] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:28.746291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.746592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:28.755970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:28.758986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:28.761572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 82/172] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 513 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:28.767371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.957083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f7612-e731-43d2-9830-9eab92da8b4c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.054764 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3fdee-cbaa-4ffe-8735-6f3459845a61 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.095533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.096213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.096490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.096762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.110081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:29.116346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:29.117884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:29.118893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:29.120009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 83/173] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:29.121200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.130684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760adb57-f7ac-4783-b897-6c70f5dde20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.130684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760adb57-f7ac-4783-b897-6c70f5dde20a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.130684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760adb57-f7ac-4783-b897-6c70f5dde20a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.130684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760adb57-f7ac-4783-b897-6c70f5dde20a None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.131245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760adb57-f7ac-4783-b897-6c70f5dde20a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:29.131245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760adb57-f7ac-4783-b897-6c70f5dde20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.133987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760adb57-f7ac-4783-b897-6c70f5dde20a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.139145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.153385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 91/174] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.164146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235e4d-9851-4829-8612-b948bcb520b1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.164654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235e4d-9851-4829-8612-b948bcb520b1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.165158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235e4d-9851-4829-8612-b948bcb520b1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.168400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 92/175] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:29.170035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235e4d-9851-4829-8612-b948bcb520b1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.199017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.261637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a727ac-b13e-4cb8-9d5d-d1a3533517d2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.300703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235e4d-9851-4829-8612-b948bcb520b1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.313383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.314322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.314853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.315334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.316518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:29.317067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.320354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.344271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 84/176] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.345411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838c2bf-9872-4526-a5bc-b3cde9777a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.345724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.346293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838c2bf-9872-4526-a5bc-b3cde9777a74 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.346685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838c2bf-9872-4526-a5bc-b3cde9777a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.347030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838c2bf-9872-4526-a5bc-b3cde9777a74 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.347886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838c2bf-9872-4526-a5bc-b3cde9777a74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:29.348247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838c2bf-9872-4526-a5bc-b3cde9777a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.349772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838c2bf-9872-4526-a5bc-b3cde9777a74 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.369037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 93/177] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.371205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24463f-5df0-4bba-baca-7f18a86fa830 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.371681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24463f-5df0-4bba-baca-7f18a86fa830 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.372154 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24463f-5df0-4bba-baca-7f18a86fa830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.395789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5d24463f-5df0-4bba-baca-7f18a86fa830 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:29.397355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5d24463f-5df0-4bba-baca-7f18a86fa830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:29.465175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.481607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 94/178] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:29.483356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fef67-f367-4731-b587-fe8cdaacabbd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.483811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fef67-f367-4731-b587-fe8cdaacabbd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.484242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fef67-f367-4731-b587-fe8cdaacabbd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.485877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 95/179] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:29.486869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fef67-f367-4731-b587-fe8cdaacabbd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.544702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54e23-2f04-4885-b6a0-8a43502d6745 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.568597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.593845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.594947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.595481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.595927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] PATH_INFO: `/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.597409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] RBAC: Authorizing `identity:get_user(user_id=55cfb5b1f26a4ec19b12e7ce5108fd60)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.599285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.601392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 85/180] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/users/55cfb5b1f26a4ec19b12e7ce5108fd60 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.602520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.694910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fef67-f367-4731-b587-fe8cdaacabbd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.752897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bbc87-004d-4beb-9123-a22e888241cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.754440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bbc87-004d-4beb-9123-a22e888241cd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.755332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bbc87-004d-4beb-9123-a22e888241cd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.755815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bbc87-004d-4beb-9123-a22e888241cd None admin] PATH_INFO: `/v3/users/37aa59325ec5426a8f56e75d1c2bbad3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.759216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bbc87-004d-4beb-9123-a22e888241cd None admin] RBAC: Authorizing `identity:get_user(user_id=37aa59325ec5426a8f56e75d1c2bbad3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.762122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bbc87-004d-4beb-9123-a22e888241cd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.765394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 96/181] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/users/37aa59325ec5426a8f56e75d1c2bbad3 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.767836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033d431-174c-49d9-987a-15bc23ed3178 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.768328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033d431-174c-49d9-987a-15bc23ed3178 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.768818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033d431-174c-49d9-987a-15bc23ed3178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.773799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038a5a-bd37-4721-814b-d2becf95068e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.802424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f033d431-174c-49d9-987a-15bc23ed3178 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:29.804643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f033d431-174c-49d9-987a-15bc23ed3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:29.816674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.817347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.817639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.817917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] PATH_INFO: `/v3/users/c79db6037e0e4400a988b3aceb9b7ae4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.834294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] RBAC: Authorizing `identity:get_user(user_id=c79db6037e0e4400a988b3aceb9b7ae4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.836323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.838101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 86/182] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/users/c79db6037e0e4400a988b3aceb9b7ae4 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.838980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.894325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.911942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.918692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 97/183] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:29.918692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dacf-32ac-4067-863b-77140dc4acfb None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.918692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dacf-32ac-4067-863b-77140dc4acfb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.918692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dacf-32ac-4067-863b-77140dc4acfb None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.918692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 98/184] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:29.918692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788dacf-32ac-4067-863b-77140dc4acfb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:30.035020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea863d1-473e-42f8-9f69-e458710fff79 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:30.087991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3f3f0-abb1-41b4-86c1-617467f0873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:30.088765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f3f0-abb1-41b4-86c1-617467f0873c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.089041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f3f0-abb1-41b4-86c1-617467f0873c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.089324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f3f0-abb1-41b4-86c1-617467f0873c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:30.093630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788dacf-32ac-4067-863b-77140dc4acfb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:30.139108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:30.139732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.140002 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.140278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:30.211566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:30.227731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3f3f0-abb1-41b4-86c1-617467f0873c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:30.230375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3f3f0-abb1-41b4-86c1-617467f0873c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:30.231717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:30.233185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:30.307739 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:30.386738 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 99/185] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:30.387768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:30.392022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 87/186] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:30.394237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2267942-a95a-4b7d-b19c-c45e5bb5fa13 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.394804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2267942-a95a-4b7d-b19c-c45e5bb5fa13 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.395307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2267942-a95a-4b7d-b19c-c45e5bb5fa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:30.419227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a2267942-a95a-4b7d-b19c-c45e5bb5fa13 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:30.420515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a2267942-a95a-4b7d-b19c-c45e5bb5fa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:30.510670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 88/187] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:30.510670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2267942-a95a-4b7d-b19c-c45e5bb5fa13 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:30.511036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:30.535955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2d98-3246-465b-9c66-20d697bf405f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:30.590877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:30.591505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.591792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.592100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:30.620836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:30.653504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2267942-a95a-4b7d-b19c-c45e5bb5fa13 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:30.702647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:30.705342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:30.713598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:30.714699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.715182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.715641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:30.734324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:30.744597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:30.746424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 89/188] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:30.756728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:30.827205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:30.852620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 100/189] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:31.144061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.144791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40858de7-8589-4760-9aaa-674f0d009582 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.144791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.144791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.144791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.145664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.145664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.145664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.145664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 90/190] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:31.145664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.145664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:31.146393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7834e-7ee0-45e8-a5ab-0b42a63a94c3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.146393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.146393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.146393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.147289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] PATH_INFO: `/v3/projects/3ba741fbf80740f78e4937a796e36314` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.147289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] RBAC: Authorizing `identity:get_project(project_id=3ba741fbf80740f78e4937a796e36314)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.147289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.147289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 101/191] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:30 2022] GET /identity/v3/projects/3ba741fbf80740f78e4937a796e36314 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:31.147289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.149160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6fcfa-3f77-4cf2-8e85-e115c3b9384d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.149307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:31.196736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.197638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.198035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.198388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.199808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.201901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.203946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 91/192] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:30 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:31.205253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.219063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f3192-c1ad-41af-84f3-31c2e05be375 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.264891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.265695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.266042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.266382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.267176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:31.267704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.269178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.282308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 102/193] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:31.283790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.306068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:31.358185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0caac-51c4-4bb9-a62e-d8c488f9d84f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.395121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84322626-7008-4a86-b42f-238be5a134b4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.412200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:31.417017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.418072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.418567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.419114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.421033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.423751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.432217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 92/194] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:31.432217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.432429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.432429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.432737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.433097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.446837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:31.452796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:31.453971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:31.455401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 103/195] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:31.456700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.571065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5006-f29e-4fca-bc7b-61b6b061aefe None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.584382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71316af-155b-4d69-ac3c-d3ade69632a1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.611052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.611846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.612285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.612738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.613500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.615224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.624481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.625268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.625680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.626071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.627170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:31.627348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=3ba741fbf80740f78e4937a796e36314, user.id=37aa59325ec5426a8f56e75d1c2bbad3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:31.627839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.629695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.637360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 104/196] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/role_assignments?user.id=37aa59325ec5426a8f56e75d1c2bbad3&scope.project.id=3ba741fbf80740f78e4937a796e36314&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:31.638234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.689998 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:31.755256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 93/197] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:31 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:31.758068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.761590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44172a-99ad-416c-915b-e571ffc54df2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.851803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.853061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.853551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.854028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.855420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=55cfb5b1f26a4ec19b12e7ce5108fd60) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:31.855952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:31.858731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:31.871583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 105/198] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/role_assignments?user.id=55cfb5b1f26a4ec19b12e7ce5108fd60&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:31.872682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.004337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566589a-6e53-47f9-80cf-51b881e115dd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.072575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.074116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.074885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.075638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] PATH_INFO: `/v3/users/c79db6037e0e4400a988b3aceb9b7ae4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.078208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] RBAC: Authorizing `identity:get_user(user_id=c79db6037e0e4400a988b3aceb9b7ae4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.081206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.085234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 94/199] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/users/c79db6037e0e4400a988b3aceb9b7ae4 => generated 283 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:32.088654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.107147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cffd5-16c1-4d9b-9d1b-6a6141368853 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.120194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:32.169449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.170378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.170510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.170855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.171711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=c79db6037e0e4400a988b3aceb9b7ae4) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:32.172026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.173533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.182759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 106/200] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/role_assignments?user.id=c79db6037e0e4400a988b3aceb9b7ae4&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:32.183390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.244964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:32.322737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa57cd-2c86-46da-b0c2-c595a74c1ef3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.343182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac08671-1dcb-42d4-b3d6-d0cfbddb7d0d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.439394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.440030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.440304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.440573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.487221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.487850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.488130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.488413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.489125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:32.489964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.491788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.498609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:32.510663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 95/201] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:32.516710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.568272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.569894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.754853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 107/202] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:32.765628 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.788426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c276-6e0f-4777-8f8a-e0ee6b9c52e5 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.819411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:32.838289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.839544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.852724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.852724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] PATH_INFO: `/v3/users/28641c1b7a644deea433172208ef7910` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.852724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=28641c1b7a644deea433172208ef7910)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.852724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.856358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 96/203] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/users/28641c1b7a644deea433172208ef7910 => generated 289 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:32.865166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.965671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.026024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1ed23-a887-41ba-8c8d-1fc963c16d5a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.098888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.100068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.100538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.104458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.106760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.109438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.113163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 108/204] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:33.124077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.166330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1cae4-be48-488e-8c1f-86f3e983d0b9 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.287193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.287193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.287193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.287193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.320996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee1a3-751c-4a8e-90c2-02e4cf9d3c67 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.391604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.392692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.393344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.393835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.395246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] RBAC: Adding query filter params (role.id=341040ab922c4a298485eb1262890305, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=c79db6037e0e4400a988b3aceb9b7ae4) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:33.395796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.399340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.407063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.412962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 109/205] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/role_assignments?user.id=c79db6037e0e4400a988b3aceb9b7ae4&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=341040ab922c4a298485eb1262890305 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:33.436758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.457498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.459068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.638169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 97/206] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:59:33.647717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.872016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe8afa-ea98-4e24-b74e-1ee4d6f480d9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.951025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60f34b-1c05-45af-ad56-f97042c96453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.952485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60f34b-1c05-45af-ad56-f97042c96453 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.953277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60f34b-1c05-45af-ad56-f97042c96453 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.954070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60f34b-1c05-45af-ad56-f97042c96453 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.956536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60f34b-1c05-45af-ad56-f97042c96453 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.959595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60f34b-1c05-45af-ad56-f97042c96453 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.964340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 110/207] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:33.972942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:34.108861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:34.124918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def89bb9-1913-4ccf-bece-b46a1eb5b061 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:34.174479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71295ce-8910-46fe-9011-fcbe6563b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:34.175154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71295ce-8910-46fe-9011-fcbe6563b606 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.175436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71295ce-8910-46fe-9011-fcbe6563b606 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.175717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71295ce-8910-46fe-9011-fcbe6563b606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.176469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71295ce-8910-46fe-9011-fcbe6563b606 None admin] RBAC: Adding query filter params (role.id=1c7e596fa48049ea87bc3896af945fa1, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64, user.id=28641c1b7a644deea433172208ef7910) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:34.176782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71295ce-8910-46fe-9011-fcbe6563b606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:34.178273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71295ce-8910-46fe-9011-fcbe6563b606 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:34.186606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 98/208] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/role_assignments?user.id=28641c1b7a644deea433172208ef7910&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=1c7e596fa48049ea87bc3896af945fa1 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:34.756955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d9e4-63a9-4fff-b635-b87507fc7473 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.759283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d9e4-63a9-4fff-b635-b87507fc7473 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.760051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d9e4-63a9-4fff-b635-b87507fc7473 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.763074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 111/209] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:34.768922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46506b35-7405-49af-9d73-45d6dfda61d4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.769696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46506b35-7405-49af-9d73-45d6dfda61d4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.769696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46506b35-7405-49af-9d73-45d6dfda61d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.792872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-46506b35-7405-49af-9d73-45d6dfda61d4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:34.794074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-46506b35-7405-49af-9d73-45d6dfda61d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:34.881212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 99/210] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:35.261841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d9e4-63a9-4fff-b635-b87507fc7473 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.403826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.477250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d9e4-63a9-4fff-b635-b87507fc7473 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.547205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.548750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.549544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.550318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.572304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:35.574513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133dc9f-4268-40d8-9194-3cda80650d95 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.575051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133dc9f-4268-40d8-9194-3cda80650d95 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.575589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133dc9f-4268-40d8-9194-3cda80650d95 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.578362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 100/211] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:35.585368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:35.587125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:35.588641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:35.589803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ead22-9d4a-4bde-a5fd-52bab5a204c8 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.589803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ead22-9d4a-4bde-a5fd-52bab5a204c8 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.589803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ead22-9d4a-4bde-a5fd-52bab5a204c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.593951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 112/212] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:35.604159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.628746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-fa9ead22-9d4a-4bde-a5fd-52bab5a204c8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:35.631352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fa9ead22-9d4a-4bde-a5fd-52bab5a204c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:35.742677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 101/213] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:35.744241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9bb4-0bee-4916-8d7e-bcce4bdbc66c None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.744656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9bb4-0bee-4916-8d7e-bcce4bdbc66c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.745212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9bb4-0bee-4916-8d7e-bcce4bdbc66c None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.747006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 102/214] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:35.753698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3501d-1e6b-44ad-9800-81d945216376 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.754164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3501d-1e6b-44ad-9800-81d945216376 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.754664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3501d-1e6b-44ad-9800-81d945216376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.789225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9ec3501d-1e6b-44ad-9800-81d945216376 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:35.792447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9ec3501d-1e6b-44ad-9800-81d945216376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:35.793644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ff7f-007b-4652-bdd3-deb3115572a2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.815548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.848966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.860011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.861601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.862117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.862545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.865299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:35.865887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:35.867820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:35.878708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 113/215] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:35.889550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.939555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 103/216] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:35.941349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ddc0-81d7-402f-9306-09d8118faa65 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.941644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ddc0-81d7-402f-9306-09d8118faa65 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.942075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ddc0-81d7-402f-9306-09d8118faa65 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.946836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 104/217] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:35.951491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f00d1-aca6-44e5-9f3a-2d7217aed8fa None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.952073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f00d1-aca6-44e5-9f3a-2d7217aed8fa None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.952638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f00d1-aca6-44e5-9f3a-2d7217aed8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.987357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0f3f00d1-aca6-44e5-9f3a-2d7217aed8fa None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:35.989544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0f3f00d1-aca6-44e5-9f3a-2d7217aed8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:36.036554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da72b2-999f-4fa4-84ae-8b618d225e37 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.081467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.082457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.082810 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.083099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] PATH_INFO: `/v3/users/b9b6b57442c9491c866f16765b0b4da5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.101784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] RBAC: Authorizing `identity:get_user(user_id=b9b6b57442c9491c866f16765b0b4da5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.103497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.106200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 114/218] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/users/b9b6b57442c9491c866f16765b0b4da5 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:36.107056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.109978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 105/219] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:36.116287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f00d1-aca6-44e5-9f3a-2d7217aed8fa None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.172698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.233978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c08ae1-0685-43c7-8ea9-197d1b34135b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.273099 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.276950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.277925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.278398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.278888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.280578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.282281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.289053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 115/220] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:36.291160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.302960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f00d1-aca6-44e5-9f3a-2d7217aed8fa None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.355712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.356865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.356965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.357215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.422598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e5b0-c251-486e-a5f4-2806166b30b7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.442897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.464357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.465549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.466086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.466377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.467867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.468062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.469553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.557578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.584932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 106/221] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:36.586821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.599510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 116/222] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:36 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:36.603267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.782536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f981d-8083-4ee8-be07-051629d2b2e0 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.783075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499622-a900-445d-9d6d-8ef29981f127 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.829367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.830792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.831231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.831685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.843403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.844495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.844993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.845362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:36.845480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:36.853157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:36.854776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 117/223] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:36.856193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.866891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:36.874699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:36.877233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 107/224] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:36.881161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.907999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.957902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:37.018174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8d85-b92d-4435-9a83-96fb1740d5db None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.092555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.093339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d9b65-c74f-4040-8932-276ccbbd564b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.093498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.093851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.094225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.095767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.097890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.102027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 118/225] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:36 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:37.110305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.173194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.174568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.175450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.176138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.177607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:37.178580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.182055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.198470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 108/226] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:37.200487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.245035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:37.249054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc933ca5-b4de-47b5-9725-9aecdc8533ad None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.308902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.310724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.311605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.312457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.314061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:37.315060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.317967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.335037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 119/227] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:37.338543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.365240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:37.373991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef238a-67c0-42dd-abe7-71d31d881691 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.443978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.446693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.447564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.448371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.450100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=b9b6b57442c9491c866f16765b0b4da5) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:37.450908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.454257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.465895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 109/228] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:37 2022] GET /identity/v3/role_assignments?user.id=b9b6b57442c9491c866f16765b0b4da5&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:37.472817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.473649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee64bb6-38a9-4227-bbb3-347c544ff6fd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.524161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.524730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.525654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.525654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] PATH_INFO: `/v3/users/c79db6037e0e4400a988b3aceb9b7ae4` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.527779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] RBAC: Authorizing `identity:get_user(user_id=c79db6037e0e4400a988b3aceb9b7ae4)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.529269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.531282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 120/229] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:37 2022] GET /identity/v3/users/c79db6037e0e4400a988b3aceb9b7ae4 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:37.540855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.631242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:37.722346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53411c8b-159a-4826-8a4a-4f37ab4c28f9 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.779022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ba30-3a86-4fc0-9bd1-e859b355781c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.809348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.810549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.811027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.811473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] PATH_INFO: `/v3/users/c79db6037e0e4400a988b3aceb9b7ae4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.817584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.818237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.818532 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.818837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.820022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] RBAC: Authorizing `identity:get_user(user_id=c79db6037e0e4400a988b3aceb9b7ae4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.820191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.821569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.822732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.823652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 121/230] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:37 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:37.825627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 110/231] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:37 2022] GET /identity/v3/users/c79db6037e0e4400a988b3aceb9b7ae4 => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:37.834149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.834985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.946107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:37.949982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a4e31-4b80-40b2-96e0-4c73120dc800 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.953749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:38.021368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:38.022050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.022329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.022678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/c79db6037e0e4400a988b3aceb9b7ae4/roles/341040ab922c4a298485eb1262890305` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.025642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] RBAC: Authorizing `identity:create_grant(project_id=773a7d5487cb4873aa7623c2ce26c411, user_id=c79db6037e0e4400a988b3aceb9b7ae4, role_id=341040ab922c4a298485eb1262890305)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:38.030746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:38.072585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9972-01e4-4f69-a65a-c74b433dffc6 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:38.110979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 122/232] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:37 2022] PUT /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/c79db6037e0e4400a988b3aceb9b7ae4/roles/341040ab922c4a298485eb1262890305 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:38.149433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944befb-3ff7-4a53-a5e3-6771e84f0ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:38.149975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944befb-3ff7-4a53-a5e3-6771e84f0ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.150466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944befb-3ff7-4a53-a5e3-6771e84f0ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.150974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944befb-3ff7-4a53-a5e3-6771e84f0ef7 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.156452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944befb-3ff7-4a53-a5e3-6771e84f0ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:38.159414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944befb-3ff7-4a53-a5e3-6771e84f0ef7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:38.162740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 111/233] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:37 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:38.172900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:38.424426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cd3aa-81bb-4edf-8acc-ec768e9b9b32 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:38.489331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dd98f-7495-43d6-8d3e-f23d1de559c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:38.490434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd98f-7495-43d6-8d3e-f23d1de559c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.490968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd98f-7495-43d6-8d3e-f23d1de559c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.491760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd98f-7495-43d6-8d3e-f23d1de559c9 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/c79db6037e0e4400a988b3aceb9b7ae4/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.495080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dd98f-7495-43d6-8d3e-f23d1de559c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=773a7d5487cb4873aa7623c2ce26c411, user_id=c79db6037e0e4400a988b3aceb9b7ae4, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:38.497775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dd98f-7495-43d6-8d3e-f23d1de559c9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:38.635021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 123/234] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:38 2022] PUT /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/c79db6037e0e4400a988b3aceb9b7ae4/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:39.582227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213f50b-c986-48f8-ad33-c4e0b33f8b1b None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.582959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213f50b-c986-48f8-ad33-c4e0b33f8b1b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.582959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213f50b-c986-48f8-ad33-c4e0b33f8b1b None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.584376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 112/235] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:39.591486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d316a3-2667-4cf6-9b61-0bd4e548abb8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.592107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d316a3-2667-4cf6-9b61-0bd4e548abb8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.592107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d316a3-2667-4cf6-9b61-0bd4e548abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.628889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-33d316a3-2667-4cf6-9b61-0bd4e548abb8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:39.630147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33d316a3-2667-4cf6-9b61-0bd4e548abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:39.652743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:39.829604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 124/236] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:39.915333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df01fd-758b-4db4-abd6-82a9ec95e437 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.915709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df01fd-758b-4db4-abd6-82a9ec95e437 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.915891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df01fd-758b-4db4-abd6-82a9ec95e437 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.917282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 113/237] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:39.924043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740a65-a381-45a4-a36a-56d03e8987ce None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.924551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740a65-a381-45a4-a36a-56d03e8987ce None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.925036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740a65-a381-45a4-a36a-56d03e8987ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.968228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-44740a65-a381-45a4-a36a-56d03e8987ce None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:39.970182 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44740a65-a381-45a4-a36a-56d03e8987ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:40.187868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df01fd-758b-4db4-abd6-82a9ec95e437 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.209188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 125/238] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:40.351699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:40.360462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df01fd-758b-4db4-abd6-82a9ec95e437 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:40.412402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:40.413098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:40.413879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:40.413879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:40.416250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:40.417798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:40.422291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 114/239] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:40.432184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740a65-a381-45a4-a36a-56d03e8987ce None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.547958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.631028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:40.679634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356ca5e-777d-4a28-a58e-287f7fd6a80a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:40.722834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:40.723739 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:40.724198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:40.724628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:40.734278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740a65-a381-45a4-a36a-56d03e8987ce None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:40.738541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:40.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:40.745714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:40.746591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:40.749823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 115/240] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:40.755811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.791619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:40.861281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50355af-1bfb-459f-a810-e7e235fdefb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:40.861979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50355af-1bfb-459f-a810-e7e235fdefb4 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:40.862272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50355af-1bfb-459f-a810-e7e235fdefb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:40.862558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50355af-1bfb-459f-a810-e7e235fdefb4 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:40.863267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50355af-1bfb-459f-a810-e7e235fdefb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:40.864757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50355af-1bfb-459f-a810-e7e235fdefb4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:40.888039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860503e-9715-4520-a353-ee8104a5e6cf None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:40.932716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:40.933359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:40.933643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:40.933922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:40.934787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:40.935108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:40.936526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:40.947053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 116/241] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:40.959743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 126/242] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:40 2022] POST /identity/v3/users => generated 293 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:40.961321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.014560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b6314-e45f-4a19-b244-d5af5786e04e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.015079 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b6314-e45f-4a19-b244-d5af5786e04e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.015868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b6314-e45f-4a19-b244-d5af5786e04e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.018928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 127/243] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:41.028825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445ae0e-ca0a-4a6c-a70b-98cd95ae9fcc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.029273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445ae0e-ca0a-4a6c-a70b-98cd95ae9fcc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.030074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445ae0e-ca0a-4a6c-a70b-98cd95ae9fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.063798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3445ae0e-ca0a-4a6c-a70b-98cd95ae9fcc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:41.065912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3445ae0e-ca0a-4a6c-a70b-98cd95ae9fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:41.075112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.092986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5178-33b5-4d92-ae85-275ef28d5949 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.152631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.153208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.153497 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.153775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] PATH_INFO: `/v3/users/f86a17c2a4934301b18750672dd68a93` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.171765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] RBAC: Authorizing `identity:get_user(user_id=f86a17c2a4934301b18750672dd68a93)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:41.173267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:41.175300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 117/244] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/users/f86a17c2a4934301b18750672dd68a93 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:41.183404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.242361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 128/245] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:41.292323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e6b44-c5b2-43e4-a10c-3721d783b17b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.292864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e6b44-c5b2-43e4-a10c-3721d783b17b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.293325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e6b44-c5b2-43e4-a10c-3721d783b17b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.301183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 129/246] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:41.315391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0090-3c53-4efe-8831-7e4b14bedda6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.315807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0090-3c53-4efe-8831-7e4b14bedda6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.316432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185abae1-f6ca-4ac1-a48d-453c6b6ca074 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.316541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0090-3c53-4efe-8831-7e4b14bedda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.361050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.361050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.361050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.361408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.371861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0ced0090-3c53-4efe-8831-7e4b14bedda6 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:41.373499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0ced0090-3c53-4efe-8831-7e4b14bedda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:41.396659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.459455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 130/247] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:41.461547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.505588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:41.508992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:41.712898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 118/248] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:59:41.719653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0090-3c53-4efe-8831-7e4b14bedda6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.800290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.901155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.952978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0090-3c53-4efe-8831-7e4b14bedda6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.000909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.001586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.001933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.002606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.003561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:42.005102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:42.007341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 131/249] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:41 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:42.008336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.009894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33377d0b-120f-43d3-9fb9-f11c51d2df47 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.117150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.117833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.118133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.118429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.123440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:42.150334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:42.160720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:42.162825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 119/250] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:42.165220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.224344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e165102-e5cd-4d6e-8adc-780d70ea16f6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.353604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.354717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.355170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.355634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.398025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:42.417562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:42.419338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:42.420909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:42.426603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 132/251] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:42.428146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.509295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac22a0-0999-4e20-929d-0ddee32c5dba None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.526135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:42.574377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.575059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.575335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.575611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.576362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] RBAC: Adding query filter params (role.id=1c7e596fa48049ea87bc3896af945fa1, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=f86a17c2a4934301b18750672dd68a93) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:42.576675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:42.578167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:42.585904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 120/252] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/role_assignments?user.id=f86a17c2a4934301b18750672dd68a93&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=1c7e596fa48049ea87bc3896af945fa1 => generated 259 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:42.586472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.765913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00ca9-3657-4137-be22-e00fc90edf1f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.823112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:42.845442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa74b6-3c70-4925-9ec7-1fdd7f6a4eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.847461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa74b6-3c70-4925-9ec7-1fdd7f6a4eef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.854150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa74b6-3c70-4925-9ec7-1fdd7f6a4eef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.854150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa74b6-3c70-4925-9ec7-1fdd7f6a4eef None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.854150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa74b6-3c70-4925-9ec7-1fdd7f6a4eef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:42.854150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa74b6-3c70-4925-9ec7-1fdd7f6a4eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:42.856589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa74b6-3c70-4925-9ec7-1fdd7f6a4eef None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:42.879114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 133/253] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:42.881896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0af5d-9cd9-464d-821f-1e9330c8e62b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.882701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0af5d-9cd9-464d-821f-1e9330c8e62b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.883671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0af5d-9cd9-464d-821f-1e9330c8e62b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.886773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 134/254] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:42.887386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c13e5b-d563-4e50-83ae-f14ea36df10e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.889827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0af5d-9cd9-464d-821f-1e9330c8e62b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.965160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91785d41-e800-4151-a188-83cf045dd6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.965701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91785d41-e800-4151-a188-83cf045dd6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.965990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91785d41-e800-4151-a188-83cf045dd6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.966272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91785d41-e800-4151-a188-83cf045dd6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.967000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91785d41-e800-4151-a188-83cf045dd6b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:42.967309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91785d41-e800-4151-a188-83cf045dd6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:42.968978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91785d41-e800-4151-a188-83cf045dd6b6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:42.988584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 121/255] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:42.989878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c05f2e-2984-4c8b-8e0f-7b3e9e6dd57f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.990221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c05f2e-2984-4c8b-8e0f-7b3e9e6dd57f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.990478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c05f2e-2984-4c8b-8e0f-7b3e9e6dd57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.032257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-97c05f2e-2984-4c8b-8e0f-7b3e9e6dd57f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:43.033547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-97c05f2e-2984-4c8b-8e0f-7b3e9e6dd57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:43.097861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:43.143188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0af5d-9cd9-464d-821f-1e9330c8e62b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:43.200327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 122/256] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:43.200912 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c05f2e-2984-4c8b-8e0f-7b3e9e6dd57f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.233004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.233561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.233843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.234110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] PATH_INFO: `/v3/users/c79db6037e0e4400a988b3aceb9b7ae4` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.238992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] RBAC: Authorizing `identity:get_user(user_id=c79db6037e0e4400a988b3aceb9b7ae4)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:43.240495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:43.244145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 135/257] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/users/c79db6037e0e4400a988b3aceb9b7ae4 => generated 283 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:43.251990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.371130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:43.409673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c05f2e-2984-4c8b-8e0f-7b3e9e6dd57f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:43.499352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda918-2365-49eb-a298-f14336c74b43 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:43.520884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.521555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.521843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.522125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] PATH_INFO: `/v3/users/b9b6b57442c9491c866f16765b0b4da5` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.527584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] RBAC: Authorizing `identity:get_user(user_id=b9b6b57442c9491c866f16765b0b4da5)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:43.529137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:43.531565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 123/258] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:43 2022] GET /identity/v3/users/b9b6b57442c9491c866f16765b0b4da5 => generated 297 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:43.537024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.577191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.577887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.578242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.578528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.606551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:43.744928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:43.746592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:43.750563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c498c-8e9f-4faa-a9f8-23a684145978 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:43.827337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.827993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.828273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.828522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.834662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:43.835140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:43.843196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 124/259] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:43 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:43.845529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.857407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:43.963719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 136/260] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:59:43.964669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.084851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.092031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7670e-3909-46c7-a114-73dc0f9b9cda None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.153088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.153775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.154060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.154341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/b9b6b57442c9491c866f16765b0b4da5/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.160468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] RBAC: Authorizing `identity:create_grant(project_id=773a7d5487cb4873aa7623c2ce26c411, user_id=b9b6b57442c9491c866f16765b0b4da5, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.161944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.180894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd1603-cad7-4f73-b7bf-ee18a65e9c0e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.221653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.222334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.222622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.222926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.236301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 125/261] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:43 2022] PUT /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/b9b6b57442c9491c866f16765b0b4da5/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:44.237290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.254689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:44.265675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:44.266598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:44.267469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:44.268063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 137/262] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:44.278315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.318086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.480334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2684-d6be-4bae-8cb4-48d2988accdd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.506282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ab6b-c61d-47e3-abce-c9f2faeb5b37 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.532926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1a3f4-7174-446d-86ab-d734a07b8273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.533565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a3f4-7174-446d-86ab-d734a07b8273 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.533853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a3f4-7174-446d-86ab-d734a07b8273 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.535158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a3f4-7174-446d-86ab-d734a07b8273 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.535881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1a3f4-7174-446d-86ab-d734a07b8273 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:44.536191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1a3f4-7174-446d-86ab-d734a07b8273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.537722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1a3f4-7174-446d-86ab-d734a07b8273 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.549407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 138/263] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:44.550868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fa326-354b-4ca6-8ce2-f4d6edfba094 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.551211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fa326-354b-4ca6-8ce2-f4d6edfba094 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.551483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fa326-354b-4ca6-8ce2-f4d6edfba094 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.552994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 139/264] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:44.554951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.555299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.555588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.555868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.558195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.561640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.561778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 126/265] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:44.563472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8a987-6147-4793-97d1-aeec2ce9040f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.564008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8a987-6147-4793-97d1-aeec2ce9040f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.564464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8a987-6147-4793-97d1-aeec2ce9040f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.567895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.592113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c5e8a987-6147-4793-97d1-aeec2ce9040f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:44.593868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c5e8a987-6147-4793-97d1-aeec2ce9040f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:44.606695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.687287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 140/266] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:44.688267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8a987-6147-4793-97d1-aeec2ce9040f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.700600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.717272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a803cac-c248-4c0a-a0b1-d8a03082a47a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.768788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.775452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.776791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.777259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.778384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] RBAC: Adding query filter params (role.id=341040ab922c4a298485eb1262890305, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=c79db6037e0e4400a988b3aceb9b7ae4) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:44.780619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.782359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.800997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 127/267] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/role_assignments?user.id=c79db6037e0e4400a988b3aceb9b7ae4&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=341040ab922c4a298485eb1262890305 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:44.866426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8a987-6147-4793-97d1-aeec2ce9040f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.923228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3141d-a957-43ae-b8b9-adc5e3491b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.924273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3141d-a957-43ae-b8b9-adc5e3491b4f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.924736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3141d-a957-43ae-b8b9-adc5e3491b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.925191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3141d-a957-43ae-b8b9-adc5e3491b4f None admin] PATH_INFO: `/v3/users/c79db6037e0e4400a988b3aceb9b7ae4` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.926569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3141d-a957-43ae-b8b9-adc5e3491b4f None admin] RBAC: Authorizing `identity:get_user(user_id=c79db6037e0e4400a988b3aceb9b7ae4)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.928261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3141d-a957-43ae-b8b9-adc5e3491b4f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.930201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 141/268] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/users/c79db6037e0e4400a988b3aceb9b7ae4 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:44.936210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.056702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.068898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5921-60c6-4171-9d0f-a3bb87ea5c85 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.114022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.114694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.114955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.115230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.224621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53fc4-70ec-41eb-9ed6-7a149512b1ba None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.225261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53fc4-70ec-41eb-9ed6-7a149512b1ba None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.225814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53fc4-70ec-41eb-9ed6-7a149512b1ba None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.227602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 142/269] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:45.230777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.232286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.234899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e48e4-5d7a-43bb-a162-97d9b7fd9881 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.235468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e48e4-5d7a-43bb-a162-97d9b7fd9881 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.235950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e48e4-5d7a-43bb-a162-97d9b7fd9881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.281567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f21e48e4-5d7a-43bb-a162-97d9b7fd9881 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:45.285231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f21e48e4-5d7a-43bb-a162-97d9b7fd9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:45.396005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.405003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 143/270] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:45.406160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e48e4-5d7a-43bb-a162-97d9b7fd9881 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.408824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.412804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 128/271] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:45.428472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.596310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e48e4-5d7a-43bb-a162-97d9b7fd9881 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.601365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66daaf-e076-4a1c-90af-31de831f1c52 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.664225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.665018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.665454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.665843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.668683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.669906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.671343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.672082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.677633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.678223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.680310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 129/272] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:45.688168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.691366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.697387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 144/273] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:45.698427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.718450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.776119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.867141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c194-cb7b-41e9-bdaa-6ae7bfb0f3e8 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.941038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.955582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.958093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.959033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.959758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.961752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=c79db6037e0e4400a988b3aceb9b7ae4) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:45.962725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.966510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.981378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 130/274] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/role_assignments?user.id=c79db6037e0e4400a988b3aceb9b7ae4&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:46.023566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.028498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a36e8a-83c7-4593-b4a3-fcb5d468c2e5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.071176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efdefa-9ab0-4a4f-8d44-51456c64025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.071813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdefa-9ab0-4a4f-8d44-51456c64025e None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.072099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdefa-9ab0-4a4f-8d44-51456c64025e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.072381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdefa-9ab0-4a4f-8d44-51456c64025e None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.073059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efdefa-9ab0-4a4f-8d44-51456c64025e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.074545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efdefa-9ab0-4a4f-8d44-51456c64025e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.216404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754e4f-d78c-4eeb-984d-645699c23611 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.250691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 145/275] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:45 2022] POST /identity/v3/users => generated 293 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:46.250691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4ac17-4448-47a6-aeaf-84a8656e3cbe None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.250691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4ac17-4448-47a6-aeaf-84a8656e3cbe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.250691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4ac17-4448-47a6-aeaf-84a8656e3cbe None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.250691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 146/276] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:46.258477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108321-7ab6-4d5f-a288-cf8260141641 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.259117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108321-7ab6-4d5f-a288-cf8260141641 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.259567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108321-7ab6-4d5f-a288-cf8260141641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.268910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.297138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-81108321-7ab6-4d5f-a288-cf8260141641 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:46.298461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.299172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.299455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.300090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-81108321-7ab6-4d5f-a288-cf8260141641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:46.300195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.314274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:46.319545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:46.320480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:46.321267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 131/277] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:46.331033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.473137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 147/278] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:46.523177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6778244-e7c6-4f91-9837-1816f63d3940 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.594990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e097d1-69dc-4f74-880d-b5c38f003d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.595946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e097d1-69dc-4f74-880d-b5c38f003d08 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.596386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e097d1-69dc-4f74-880d-b5c38f003d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.596829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e097d1-69dc-4f74-880d-b5c38f003d08 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.597939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e097d1-69dc-4f74-880d-b5c38f003d08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:46.598418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e097d1-69dc-4f74-880d-b5c38f003d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.601405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e097d1-69dc-4f74-880d-b5c38f003d08 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.618135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 132/279] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:46.627398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81108321-7ab6-4d5f-a288-cf8260141641 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.742328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.785643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ead8f-450a-41be-9833-d72e891d9ba5 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.786144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ead8f-450a-41be-9833-d72e891d9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.786653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ead8f-450a-41be-9833-d72e891d9ba5 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.790608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 133/280] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:46.798385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78417d75-814e-407c-abf3-47d091dc202a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.798385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78417d75-814e-407c-abf3-47d091dc202a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.798590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78417d75-814e-407c-abf3-47d091dc202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.823276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81108321-7ab6-4d5f-a288-cf8260141641 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.824569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-78417d75-814e-407c-abf3-47d091dc202a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:46.826310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-78417d75-814e-407c-abf3-47d091dc202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:46.883158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.883825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.884110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.884401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] PATH_INFO: `/v3/users/7dd4434c926c4367a4674bc7247ef3ec` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.885368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.903701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd4434c926c4367a4674bc7247ef3ec)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.905529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.907929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 148/281] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/users/7dd4434c926c4367a4674bc7247ef3ec => generated 293 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:46.909230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.943266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 134/282] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:46.945761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78417d75-814e-407c-abf3-47d091dc202a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.220295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4398f8-6001-4d88-b116-83f69cfd6247 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.266996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:47.273714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78417d75-814e-407c-abf3-47d091dc202a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.306687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.308519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.309019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.309521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.342767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:47.343288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.344714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.345559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.346266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.348036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, user.id=7dd4434c926c4367a4674bc7247ef3ec, scope.system=all) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:47.348866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.351872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:47.352943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:47.354471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 149/283] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:47.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.368699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 135/284] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/role_assignments?user.id=7dd4434c926c4367a4674bc7247ef3ec&scope.system=all&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 226 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:47.370670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.504496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:47.704792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bee57-c868-4937-ad5a-451ab416585c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.705545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d07a-6858-496b-8f76-31019e044877 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.835971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.836879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.837373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.839029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.840094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.840567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.841039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.841987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.843309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:47.843809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.849166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.872799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:47.877676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:47.879383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:47.880941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:47.883967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 136/285] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:47.884221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 150/286] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 525 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:47.888186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.892109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.995456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:48.120518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8c3b9-0045-4279-8b66-7c0421b702f3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.176224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:48.180573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd4a5-9f7e-4488-b356-2aaceeaf2fb4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.192902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.194617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.195700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.196461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] PATH_INFO: `/v3/users/f86a17c2a4934301b18750672dd68a93` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.198978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] RBAC: Authorizing `identity:get_user(user_id=f86a17c2a4934301b18750672dd68a93)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.202176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.214622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 151/287] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/users/f86a17c2a4934301b18750672dd68a93 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:48.220198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.220829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.221114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.221396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.222089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:48.222473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.223755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:48.224407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.234924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 137/288] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:48.243805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:48.391833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739b84-021d-4c3d-bbe6-89616ec77fbf None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.434461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.435295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.435589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.435871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] PATH_INFO: `/v3/users/b9b6b57442c9491c866f16765b0b4da5` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.437399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] RBAC: Authorizing `identity:get_user(user_id=b9b6b57442c9491c866f16765b0b4da5)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.439057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.440821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 138/289] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:48 2022] GET /identity/v3/users/b9b6b57442c9491c866f16765b0b4da5 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:48.449759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:48.507850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385e74-0853-4f95-a9db-e00d964d4137 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.514745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:48.519445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:48.557259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.557918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.558192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.558476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.559777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.561251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.564870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 152/290] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:48 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:48.571146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:48.711793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddea67-7b73-454c-ad28-7aa6622a3372 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.793150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e335-340d-449c-838c-1c689a014991 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.797359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.798417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.798951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.799450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.833035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81854-6f7f-4c01-93e7-53c2aeeed173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.833712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81854-6f7f-4c01-93e7-53c2aeeed173 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.834042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81854-6f7f-4c01-93e7-53c2aeeed173 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.834323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81854-6f7f-4c01-93e7-53c2aeeed173 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/f86a17c2a4934301b18750672dd68a93/roles/1c7e596fa48049ea87bc3896af945fa1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.840292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81854-6f7f-4c01-93e7-53c2aeeed173 None admin] RBAC: Authorizing `identity:create_grant(project_id=773a7d5487cb4873aa7623c2ce26c411, user_id=f86a17c2a4934301b18750672dd68a93, role_id=1c7e596fa48049ea87bc3896af945fa1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.841992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81854-6f7f-4c01-93e7-53c2aeeed173 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.922007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 153/291] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:48 2022] PUT /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411/users/f86a17c2a4934301b18750672dd68a93/roles/1c7e596fa48049ea87bc3896af945fa1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:48.923671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.925398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.971254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:49.039036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016d55-d227-4910-b502-0865af6b2d65 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.039585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016d55-d227-4910-b502-0865af6b2d65 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.039881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016d55-d227-4910-b502-0865af6b2d65 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.045423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 154/292] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:49.047834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b6806-c9fe-4c02-b47b-ac372cc9fbbb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.048124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b6806-c9fe-4c02-b47b-ac372cc9fbbb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.048400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b6806-c9fe-4c02-b47b-ac372cc9fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.083783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ef9b6806-c9fe-4c02-b47b-ac372cc9fbbb None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:49.085012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 139/293] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:49.090224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ef9b6806-c9fe-4c02-b47b-ac372cc9fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:49.091604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:49.138917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:49.236237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 155/294] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:49.277343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5a091-2a86-48bd-84ff-18fe56639c25 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:49.330693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:49.338329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50283-821f-48e4-8af9-48017782a97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:49.339014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50283-821f-48e4-8af9-48017782a97b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.339293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50283-821f-48e4-8af9-48017782a97b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.339571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50283-821f-48e4-8af9-48017782a97b None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.340799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50283-821f-48e4-8af9-48017782a97b None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:49.342268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50283-821f-48e4-8af9-48017782a97b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:49.350810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 140/295] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:49 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:49.354023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b6806-c9fe-4c02-b47b-ac372cc9fbbb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:49.581966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b6806-c9fe-4c02-b47b-ac372cc9fbbb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:49.647342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db87cf2-8d00-40c3-af03-7076b614dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:49.648700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db87cf2-8d00-40c3-af03-7076b614dd79 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.649094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db87cf2-8d00-40c3-af03-7076b614dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.649474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db87cf2-8d00-40c3-af03-7076b614dd79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.650561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db87cf2-8d00-40c3-af03-7076b614dd79 None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=b9b6b57442c9491c866f16765b0b4da5) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:49.651033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db87cf2-8d00-40c3-af03-7076b614dd79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:49.653157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db87cf2-8d00-40c3-af03-7076b614dd79 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:49.666659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 156/296] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:49 2022] GET /identity/v3/role_assignments?user.id=b9b6b57442c9491c866f16765b0b4da5&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:49.884237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e6720-3e5f-4865-8bfe-66d850d2e937 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.885049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e6720-3e5f-4865-8bfe-66d850d2e937 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.885049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e6720-3e5f-4865-8bfe-66d850d2e937 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.886452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 141/297] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:49.895307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce9c54-ff34-4a6b-a2f6-16b061d44d40 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.895804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce9c54-ff34-4a6b-a2f6-16b061d44d40 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.896251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce9c54-ff34-4a6b-a2f6-16b061d44d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.931731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-02ce9c54-ff34-4a6b-a2f6-16b061d44d40 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:49.932958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-02ce9c54-ff34-4a6b-a2f6-16b061d44d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:49.964194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:49.965122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e6720-3e5f-4865-8bfe-66d850d2e937 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.081996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 157/298] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:50.118933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e6720-3e5f-4865-8bfe-66d850d2e937 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.159106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.159673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.159947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.160220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.174787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:50.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:50.182374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:50.183220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:50.184784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 142/299] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:50.189831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce9c54-ff34-4a6b-a2f6-16b061d44d40 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.301141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce9c54-ff34-4a6b-a2f6-16b061d44d40 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.341286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0c4bd-2caf-43d4-95a8-77f71e923f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.341926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0c4bd-2caf-43d4-95a8-77f71e923f49 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.342204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0c4bd-2caf-43d4-95a8-77f71e923f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.342477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0c4bd-2caf-43d4-95a8-77f71e923f49 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.343217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0c4bd-2caf-43d4-95a8-77f71e923f49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:50.343521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0c4bd-2caf-43d4-95a8-77f71e923f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.344959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0c4bd-2caf-43d4-95a8-77f71e923f49 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:50.356166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 158/300] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:50.361899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.438040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.488164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc8ca-0528-460b-ad36-788d6b9d2556 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.493855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29ec5-f7d5-4d67-a517-aa6dfc45d1f8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.494140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29ec5-f7d5-4d67-a517-aa6dfc45d1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.494415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29ec5-f7d5-4d67-a517-aa6dfc45d1f8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.496088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 159/301] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:50.505377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a045-03a8-4c35-aeb3-6c22ca7a87b4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.506202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a045-03a8-4c35-aeb3-6c22ca7a87b4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.507542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a045-03a8-4c35-aeb3-6c22ca7a87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.534555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.535251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.535530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.535807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] PATH_INFO: `/v3/users/c257ce80f1744b55a6d150396e84176d` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.541275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ac94a045-03a8-4c35-aeb3-6c22ca7a87b4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:50.543891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ac94a045-03a8-4c35-aeb3-6c22ca7a87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:50.552485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] RBAC: Authorizing `identity:get_user(user_id=c257ce80f1744b55a6d150396e84176d)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.554253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:50.556455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 143/302] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:50 2022] GET /identity/v3/users/c257ce80f1744b55a6d150396e84176d => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:50.563168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.591036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.690957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 160/303] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:50.691202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84710cc9-ea23-4ca5-9a9e-0968636eb90a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.693642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a045-03a8-4c35-aeb3-6c22ca7a87b4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.743203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.765680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.766670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.767155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.767664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.769091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] RBAC: Adding query filter params (role.id=1c7e596fa48049ea87bc3896af945fa1, user.id=c257ce80f1744b55a6d150396e84176d, scope.system=all) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:50.769816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.773478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:50.791285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 144/304] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 17 19:59:50 2022] GET /identity/v3/role_assignments?user.id=c257ce80f1744b55a6d150396e84176d&scope.system=all&role.id=1c7e596fa48049ea87bc3896af945fa1 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:50.806230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a045-03a8-4c35-aeb3-6c22ca7a87b4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.848314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.848967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.849251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.849533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.851432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.853050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:50.854826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 161/305] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:50.863013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.074772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5746-f7c4-442d-9633-4992445ecf9d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:51.142954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fe53e-b4a6-4646-a64b-ac074350dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:51.144037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe53e-b4a6-4646-a64b-ac074350dca1 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.144543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe53e-b4a6-4646-a64b-ac074350dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.145059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe53e-b4a6-4646-a64b-ac074350dca1 None admin] PATH_INFO: `/v3/groups` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.146207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fe53e-b4a6-4646-a64b-ac074350dca1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:51.149164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fe53e-b4a6-4646-a64b-ac074350dca1 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:51.239624 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.246778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 145/306] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 17 19:59:50 2022] POST /identity/v3/groups => generated 229 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:51.272018 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:51.330863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fad2d-91ed-45ba-9c2b-0e0856b8ba70 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.331904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fad2d-91ed-45ba-9c2b-0e0856b8ba70 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.332691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fad2d-91ed-45ba-9c2b-0e0856b8ba70 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.338697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 146/307] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:51.345069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72672ae-d0f4-41b9-b46d-8c4b2ef3c40e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.345490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72672ae-d0f4-41b9-b46d-8c4b2ef3c40e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.345651 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72672ae-d0f4-41b9-b46d-8c4b2ef3c40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.375259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a72672ae-d0f4-41b9-b46d-8c4b2ef3c40e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:51.377309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a72672ae-d0f4-41b9-b46d-8c4b2ef3c40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:51.455810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:51.476689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ea60-0ce8-4093-b72c-97e5742d9058 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:51.530659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 147/308] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:51.552733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:51.553940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.554446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.554996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.576522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:51.587478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:51.588417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:51.589189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:51.590350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 162/309] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:51.599657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72672ae-d0f4-41b9-b46d-8c4b2ef3c40e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.807478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72672ae-d0f4-41b9-b46d-8c4b2ef3c40e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:51.818347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.874178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:51.875580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.876125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.877726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.878733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:51.879262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:51.880882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:51.893440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 148/310] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:51.904547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.961352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:51.966611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:52.009600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0da771-3fd6-4220-aec0-acb7575cb8e5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.087358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df8140-930b-452f-b939-e1165559954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.088756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df8140-930b-452f-b939-e1165559954e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.089451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df8140-930b-452f-b939-e1165559954e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.090133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df8140-930b-452f-b939-e1165559954e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.116604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2932edb-8eb1-481c-bfd2-e8a0fc13866b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.117877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df8140-930b-452f-b939-e1165559954e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-00df8140-930b-452f-b939-e1165559954e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:52.129869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:52.131872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:52.133657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:52.138498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 163/311] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:52.144106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df8140-930b-452f-b939-e1165559954e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.176776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.177437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.177715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.177995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] PATH_INFO: `/v3/users/7dd4434c926c4367a4674bc7247ef3ec` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.180842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd4434c926c4367a4674bc7247ef3ec)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.182327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.184837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 149/312] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/users/7dd4434c926c4367a4674bc7247ef3ec => generated 293 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:52.191188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.326974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:52.332675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1ef6-947d-43e4-b6b0-3075934282a4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.385970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.387423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.387706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.387989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] PATH_INFO: `/v3/system/users/7dd4434c926c4367a4674bc7247ef3ec/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.390236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7dd4434c926c4367a4674bc7247ef3ec, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.391731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.402812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df8140-930b-452f-b939-e1165559954e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.467906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.469032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.469569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.470070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.471750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:52.472318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.475124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.478476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:52.498997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 164/313] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:52.501795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.505055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 150/314] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 17 19:59:52 2022] PUT /identity/v3/system/users/7dd4434c926c4367a4674bc7247ef3ec/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:52.727975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6ddcc-2163-40af-aef9-f9aa1f185803 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.795781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.796890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.797403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.797920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] PATH_INFO: `/v3/users/f86a17c2a4934301b18750672dd68a93` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.800056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] RBAC: Authorizing `identity:get_user(user_id=f86a17c2a4934301b18750672dd68a93)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.802969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.807387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 165/315] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:52 2022] GET /identity/v3/users/f86a17c2a4934301b18750672dd68a93 => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:52.814164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.938811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c21e76-d59a-4ba2-b7e8-44a76c8f3e92 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.979719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7f36a-b5b8-4f88-9bc0-58c03a0e6ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.980723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7f36a-b5b8-4f88-9bc0-58c03a0e6ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.981207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7f36a-b5b8-4f88-9bc0-58c03a0e6ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.981672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7f36a-b5b8-4f88-9bc0-58c03a0e6ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.018293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:53.066935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7f36a-b5b8-4f88-9bc0-58c03a0e6ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:53.068623 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7f36a-b5b8-4f88-9bc0-58c03a0e6ab7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:53.200635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 151/316] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:53.202695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:53.326955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:53.360181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6fa9c-0e96-4fa5-82e8-71b56eba4964 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.360664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6fa9c-0e96-4fa5-82e8-71b56eba4964 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.361154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6fa9c-0e96-4fa5-82e8-71b56eba4964 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.363733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 152/317] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:53.373076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b792-a20c-42cf-8890-ba7e4ebdc69b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.373526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b792-a20c-42cf-8890-ba7e4ebdc69b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.374387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b792-a20c-42cf-8890-ba7e4ebdc69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.405053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-30d2b792-a20c-42cf-8890-ba7e4ebdc69b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:53.406667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-30d2b792-a20c-42cf-8890-ba7e4ebdc69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:53.437377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c2c7-b8d3-4b1e-a3f3-30b6ec46382d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:53.484545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:53.502735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 153/318] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:53.520387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a663c6-83ff-4dbb-bdfb-392529cfc322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:53.521457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a663c6-83ff-4dbb-bdfb-392529cfc322 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.521946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a663c6-83ff-4dbb-bdfb-392529cfc322 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.524071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a663c6-83ff-4dbb-bdfb-392529cfc322 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.526271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a663c6-83ff-4dbb-bdfb-392529cfc322 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:53.529007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a663c6-83ff-4dbb-bdfb-392529cfc322 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:53.538983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 166/319] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:53 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:53.543290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b792-a20c-42cf-8890-ba7e4ebdc69b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:53.638005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd07b-5a58-4358-8037-93c5572ba3fe None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.638495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd07b-5a58-4358-8037-93c5572ba3fe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.639021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd07b-5a58-4358-8037-93c5572ba3fe None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.641591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 167/320] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:53.650123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54fffe-4258-4e86-9b36-cf61f665d669 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.650612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54fffe-4258-4e86-9b36-cf61f665d669 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.651128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54fffe-4258-4e86-9b36-cf61f665d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.692758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4d54fffe-4258-4e86-9b36-cf61f665d669 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:53.695530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4d54fffe-4258-4e86-9b36-cf61f665d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:53.747854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b792-a20c-42cf-8890-ba7e4ebdc69b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:53.800311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:53.800939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.801214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.801488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.802238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] RBAC: Adding query filter params (role.id=1c7e596fa48049ea87bc3896af945fa1, scope.project.id=773a7d5487cb4873aa7623c2ce26c411, user.id=f86a17c2a4934301b18750672dd68a93) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:53.802547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:53.805147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:53.812258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 154/321] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:53 2022] GET /identity/v3/role_assignments?user.id=f86a17c2a4934301b18750672dd68a93&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=1c7e596fa48049ea87bc3896af945fa1 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:53.812881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:53.824607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 168/322] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:53.889076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:53.943236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933981-acaf-4935-9e6c-2220ad4d84bb None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:53.984211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:53.985255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.985746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.986251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.987749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:53.989470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:53.991778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 155/323] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:54.000471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54fffe-4258-4e86-9b36-cf61f665d669 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:54.074829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:54.120466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54fffe-4258-4e86-9b36-cf61f665d669 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:54.162086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:54.163310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.163638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.163924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] PATH_INFO: `/v3/groups` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.164667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:54.166124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:54.288645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 169/324] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 17 19:59:53 2022] POST /identity/v3/groups => generated 226 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:54.343627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:54.547440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d482e-a920-463f-a738-1c49ec48de32 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:54.595708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:54.608799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:54.611385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.611385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.611385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.626426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:54.632053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:54.633904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:54.636218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 156/325] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:54.643846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:54.818424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ee2f8-de31-41d4-ad3c-6f7e92abdfc6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:54.847781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:54.865020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:54.865650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.866474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.866795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.867632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:54.867936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:54.869324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:54.884579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 170/326] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:54.891308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.118447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d3d7b-8f12-4334-bbbc-719d718b08cb None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:55.183114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f52c1e-fe9e-4258-a7b3-6d28a9aab25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.184239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52c1e-fe9e-4258-a7b3-6d28a9aab25d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.184737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52c1e-fe9e-4258-a7b3-6d28a9aab25d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.185234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52c1e-fe9e-4258-a7b3-6d28a9aab25d None admin] PATH_INFO: `/v3/users/c257ce80f1744b55a6d150396e84176d` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.188022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f52c1e-fe9e-4258-a7b3-6d28a9aab25d None admin] RBAC: Authorizing `identity:get_user(user_id=c257ce80f1744b55a6d150396e84176d)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:55.190568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f52c1e-fe9e-4258-a7b3-6d28a9aab25d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:55.194123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 157/327] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:54 2022] GET /identity/v3/users/c257ce80f1744b55a6d150396e84176d => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:55.200910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.209047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c88eb-9bcc-4bba-85ad-69959fca1824 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.209589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c88eb-9bcc-4bba-85ad-69959fca1824 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.210090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c88eb-9bcc-4bba-85ad-69959fca1824 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.212892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 158/328] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:55.222284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6f4f-dd3b-4dea-b835-4559655a4c5a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.223309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6f4f-dd3b-4dea-b835-4559655a4c5a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.224109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6f4f-dd3b-4dea-b835-4559655a4c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.266149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-746c6f4f-dd3b-4dea-b835-4559655a4c5a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:55.268921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-746c6f4f-dd3b-4dea-b835-4559655a4c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:55.378278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:55.386856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac334-13c6-4154-8e31-d7db155130cf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:55.422348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 159/329] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:55.456383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.457448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.457903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.458349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] PATH_INFO: `/v3/system/users/c257ce80f1744b55a6d150396e84176d/roles/1c7e596fa48049ea87bc3896af945fa1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.462148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c257ce80f1744b55a6d150396e84176d, role_id=1c7e596fa48049ea87bc3896af945fa1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:55.464851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:55.566910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 171/330] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 17 19:59:55 2022] PUT /identity/v3/system/users/c257ce80f1744b55a6d150396e84176d/roles/1c7e596fa48049ea87bc3896af945fa1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:56.295439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c6f4f-dd3b-4dea-b835-4559655a4c5a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:56.544967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c6f4f-dd3b-4dea-b835-4559655a4c5a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:56.620914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:56.622025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:56.622483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:56.622963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:56.648765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:56.657921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:56.659695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:56.661280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 19:59:56.666663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 160/331] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:56.670281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:56.817850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:56.947983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac38be-4047-4309-9e87-db2ace7717fb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.027941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f30a0b-9905-4b04-a36a-5d0379e33496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.029027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f30a0b-9905-4b04-a36a-5d0379e33496 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.029772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f30a0b-9905-4b04-a36a-5d0379e33496 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.030266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f30a0b-9905-4b04-a36a-5d0379e33496 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.031592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f30a0b-9905-4b04-a36a-5d0379e33496 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:57.032149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f30a0b-9905-4b04-a36a-5d0379e33496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:57.034888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f30a0b-9905-4b04-a36a-5d0379e33496 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:57.053082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 172/332] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:57.062912 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:57.166495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:57.277262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42818d-8433-4823-abdf-34cedc48e2bb None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.277674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42818d-8433-4823-abdf-34cedc48e2bb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.278143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42818d-8433-4823-abdf-34cedc48e2bb None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.285406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 173/333] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:57.297387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a6f7-df62-40d5-99f0-67a64a5db4e5 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.302515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3f06c-f886-4ed0-ba81-56d41be0e4a8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.303101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3f06c-f886-4ed0-ba81-56d41be0e4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.304165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3f06c-f886-4ed0-ba81-56d41be0e4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.364526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-53d3f06c-f886-4ed0-ba81-56d41be0e4a8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:57.367267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-53d3f06c-f886-4ed0-ba81-56d41be0e4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:57.398226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.399662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.400359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.401178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] PATH_INFO: `/v3/users/7dd4434c926c4367a4674bc7247ef3ec` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.403676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd4434c926c4367a4674bc7247ef3ec)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:57.407003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:57.410596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 161/334] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:57 2022] GET /identity/v3/users/7dd4434c926c4367a4674bc7247ef3ec => generated 293 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:57.418070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:57.561687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 174/335] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:57.720126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ec1de-00f3-4f30-95e3-53586de36f02 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.751489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:57.793144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.794182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.794784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.795277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.796678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] RBAC: Adding query filter params (role.id=f4d54ec4c8844bc6a93b694e46f8da14, user.id=7dd4434c926c4367a4674bc7247ef3ec, scope.system=all) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:57.797221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:57.800190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:57.828835 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 162/336] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 17 19:59:57 2022] GET /identity/v3/role_assignments?user.id=7dd4434c926c4367a4674bc7247ef3ec&scope.system=all&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 510 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:58.713322 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3f06c-f886-4ed0-ba81-56d41be0e4a8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:58.819190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:58.961954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3f06c-f886-4ed0-ba81-56d41be0e4a8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:59.032631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:59.034261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.035071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.035875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.058063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:59.068173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:59.070472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:59.072073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 19:59:59.076951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 175/337] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:59.087556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:59.344334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ff37-4e07-46c7-97a0-db58e27d6e2e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:59.431364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18eb07-3cac-4902-b333-df113e83133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:59.432469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18eb07-3cac-4902-b333-df113e83133b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.432993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18eb07-3cac-4902-b333-df113e83133b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.433486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18eb07-3cac-4902-b333-df113e83133b None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.434822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18eb07-3cac-4902-b333-df113e83133b None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:59.435381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18eb07-3cac-4902-b333-df113e83133b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:59.438087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18eb07-3cac-4902-b333-df113e83133b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:59.460794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 163/338] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:59.469348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:59.699117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:59.707773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9672b-1fc4-45d6-8d10-213f3a6f649d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:59.745613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09c3a-09db-4c28-9f60-8f7f30180bae None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.746546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09c3a-09db-4c28-9f60-8f7f30180bae None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.747418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09c3a-09db-4c28-9f60-8f7f30180bae None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.750985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 164/339] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 19:59:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:59.761165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f833-af3e-4dbc-b9d7-73993d80ae19 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.762104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f833-af3e-4dbc-b9d7-73993d80ae19 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.762927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f833-af3e-4dbc-b9d7-73993d80ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.773014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:59.773975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.774238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.774502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.814046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-38b7f833-af3e-4dbc-b9d7-73993d80ae19 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:59.816792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-38b7f833-af3e-4dbc-b9d7-73993d80ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:59.873463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:59.932139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:59.935205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.040831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 165/340] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:00.043531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8c196-b1e3-4b6a-af3d-2ca2062726c9 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.044288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8c196-b1e3-4b6a-af3d-2ca2062726c9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.044973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8c196-b1e3-4b6a-af3d-2ca2062726c9 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.048198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 166/341] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:00.056815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce9ab-6486-4e54-aca8-206def4bdc0d None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.057592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce9ab-6486-4e54-aca8-206def4bdc0d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.058296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce9ab-6486-4e54-aca8-206def4bdc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.112613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b06ce9ab-6486-4e54-aca8-206def4bdc0d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:00.116386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b06ce9ab-6486-4e54-aca8-206def4bdc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:00.249472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 176/342] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 781 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:00.253433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:00.270243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.375378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 167/343] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:00.467695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51474268-027d-4c5b-b482-aa20b923efa5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.519338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98f420-b112-4735-96f3-0c950222d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.520337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f420-b112-4735-96f3-0c950222d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.520849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f420-b112-4735-96f3-0c950222d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.521313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f420-b112-4735-96f3-0c950222d3b0 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.527662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98f420-b112-4735-96f3-0c950222d3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:00.529883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98f420-b112-4735-96f3-0c950222d3b0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.532504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 177/344] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:00.541517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce9ab-6486-4e54-aca8-206def4bdc0d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.762449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3017-187f-4a0c-aa73-cb49e0e6e4a1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.763159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3017-187f-4a0c-aa73-cb49e0e6e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.763672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3017-187f-4a0c-aa73-cb49e0e6e4a1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.765964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 178/345] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:00.773969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49fe2d-db50-445f-a582-53b0155e1f32 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.775613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49fe2d-db50-445f-a582-53b0155e1f32 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.776127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49fe2d-db50-445f-a582-53b0155e1f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.811465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-db49fe2d-db50-445f-a582-53b0155e1f32 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:00.816098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-db49fe2d-db50-445f-a582-53b0155e1f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:00.823252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:00.834504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce9ab-6486-4e54-aca8-206def4bdc0d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.920258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.920935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.921220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.921499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.934900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:00.936840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.940023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 168/346] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:00.940619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.974204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:00.983147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 179/347] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:00.984251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49fe2d-db50-445f-a582-53b0155e1f32 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.158856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a891b4-a702-44bf-ac47-d8193fce2d45 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.198989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.199895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.200315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.200719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.214357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:01.215240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49fe2d-db50-445f-a582-53b0155e1f32 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:01.220706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:01.221814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:01.222598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:01.226828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 169/348] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:01.227895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.254291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:01.317553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.318602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.319643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.320106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.320989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:01.321490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:01.323910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:01.335517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 180/349] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 260 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:01.336821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.379658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ef81b-ce2e-4ee4-b251-27984fd8949e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.444419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00769f2b-ab75-45a4-b75d-edf416ed5d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.446239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769f2b-ab75-45a4-b75d-edf416ed5d6d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.446987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769f2b-ab75-45a4-b75d-edf416ed5d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.447535 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769f2b-ab75-45a4-b75d-edf416ed5d6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.467283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00769f2b-ab75-45a4-b75d-edf416ed5d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-00769f2b-ab75-45a4-b75d-edf416ed5d6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:01.473975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:01.476383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:01.477301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:01.480047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 170/350] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:01.480047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fdbe2-3300-4f3e-96d5-850b1f948304 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.480492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fdbe2-3300-4f3e-96d5-850b1f948304 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.480492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fdbe2-3300-4f3e-96d5-850b1f948304 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.481445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:01.481871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 171/351] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:01.483221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a55cd-1c2d-42c4-a8f6-acb07d8cb13d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.483502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a55cd-1c2d-42c4-a8f6-acb07d8cb13d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.483736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a55cd-1c2d-42c4-a8f6-acb07d8cb13d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.485193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 172/352] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:01.485982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a55cd-1c2d-42c4-a8f6-acb07d8cb13d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.563990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfd65-d9d4-4b72-90b3-7899049bfb54 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.631692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaec05-50c9-476a-8dd0-61eb3e619f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.632826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:01.633864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaec05-50c9-476a-8dd0-61eb3e619f52 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.633864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaec05-50c9-476a-8dd0-61eb3e619f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.634603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaec05-50c9-476a-8dd0-61eb3e619f52 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.636888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaec05-50c9-476a-8dd0-61eb3e619f52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:01.636888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaec05-50c9-476a-8dd0-61eb3e619f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:01.639212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaec05-50c9-476a-8dd0-61eb3e619f52 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:01.657777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 181/353] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:01.661259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351966-9550-4505-aab2-987637bd70bf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.662111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351966-9550-4505-aab2-987637bd70bf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.663540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351966-9550-4505-aab2-987637bd70bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.685968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a55cd-1c2d-42c4-a8f6-acb07d8cb13d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.704502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e8351966-9550-4505-aab2-987637bd70bf None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:01.706546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e8351966-9550-4505-aab2-987637bd70bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:01.766300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba9ae3-ddf2-44e1-bb89-473ab51c3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.767857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9ae3-ddf2-44e1-bb89-473ab51c3959 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.768500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9ae3-ddf2-44e1-bb89-473ab51c3959 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.769585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9ae3-ddf2-44e1-bb89-473ab51c3959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.795062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba9ae3-ddf2-44e1-bb89-473ab51c3959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-7aba9ae3-ddf2-44e1-bb89-473ab51c3959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:01.805320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:01.807124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:01.808703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:01.812846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 173/354] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:01.818827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7eff8-b1b9-4afa-bcfa-de1399b636a1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.818827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7eff8-b1b9-4afa-bcfa-de1399b636a1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.818827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7eff8-b1b9-4afa-bcfa-de1399b636a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.853213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 182/355] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:01.853982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-20b7eff8-b1b9-4afa-bcfa-de1399b636a1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:01.854503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8351966-9550-4505-aab2-987637bd70bf None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.855936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-20b7eff8-b1b9-4afa-bcfa-de1399b636a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:01.988561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.009775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 174/356] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:02.011723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7eff8-b1b9-4afa-bcfa-de1399b636a1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.085835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8351966-9550-4505-aab2-987637bd70bf None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.156804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.157611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.158073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.158543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.159769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:02.160299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.163413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.186269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 183/357] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:02.187844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.193085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.277981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7eff8-b1b9-4afa-bcfa-de1399b636a1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.357558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.358734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.359203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.359790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.392167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078774e-ee87-4920-92a2-8ca4472f018f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.422827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.458558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.460154 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.460646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.461131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.462367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:02.463077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.465498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.482897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 184/358] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:02.484519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.549028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.552534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.665330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae9ac-c759-49d1-a8c0-822a4a3cc27b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.677177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.722461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 175/359] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:02.723456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.743135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.744138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.744615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.745221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.832422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.876524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.878514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.946139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e303a-2f18-4550-a31f-3b2b14519f61 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.018268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.019849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.020524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.020936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.088610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 185/360] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:03.090675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.101195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.187486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:03.190842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:03.254268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.302505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70966-6c84-46f5-8ea2-54418c1c35cd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.360059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.360750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.361036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.361317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.368571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 176/361] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:03.369453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.386046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:03.393087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:03.394119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:03.394946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 186/362] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:03.395610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.470188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.533267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3ae1-c37e-4270-a50e-61718cbe13f1 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.553179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69921-857f-4a20-9dd6-852ba5a123f5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.590888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.592216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.592518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.592801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.604760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.605438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.605887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.606088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.613788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:03.613788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:03.614023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 187/363] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:03.614856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.620667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:03.624314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:03.627528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:03.628508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 177/364] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:03.629274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.780441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57f6a-a2ff-4c4f-a896-1b3e597f2862 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.808352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b799-b060-4112-9f26-6dfba5c66e34 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.831044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.831801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.832175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.832531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.834096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:03.837183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:03.839637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 188/365] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:03.840589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.843204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.853938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.855014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.855309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.855592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] PATH_INFO: `/v3/projects/036067fc874c4d13970eee6f98f3d00e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.857169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] RBAC: Authorizing `identity:get_project(project_id=036067fc874c4d13970eee6f98f3d00e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:03.858710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:03.860503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 178/366] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/projects/036067fc874c4d13970eee6f98f3d00e => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:03.861953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.947178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.985446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ae84a-2a32-42fa-bb5b-5085aa03d14c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.000482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5289-131d-4df4-9682-e9320f3b3681 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.024790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.025417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.025696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.025973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.026950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:04.026950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.028351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.037495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 189/367] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.037896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793192db-e157-4055-8b83-ea5fb4cd7b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.038502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793192db-e157-4055-8b83-ea5fb4cd7b7a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.038893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793192db-e157-4055-8b83-ea5fb4cd7b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.039088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.039239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793192db-e157-4055-8b83-ea5fb4cd7b7a None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.040386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793192db-e157-4055-8b83-ea5fb4cd7b7a None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.041900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793192db-e157-4055-8b83-ea5fb4cd7b7a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.043943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 179/368] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.045594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12c5f-09d8-4fc4-984a-4278858043d6 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.045594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12c5f-09d8-4fc4-984a-4278858043d6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.046375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12c5f-09d8-4fc4-984a-4278858043d6 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.047395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 180/369] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:04.048007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad12c5f-09d8-4fc4-984a-4278858043d6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.119065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.166027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33f2de-44fd-497f-87e0-865d680ccb39 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.181969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad12c5f-09d8-4fc4-984a-4278858043d6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.213410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.213952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.214246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.214516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.215235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:04.215543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.216945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.219613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.221443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.222095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.222434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.222793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.224081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.226353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.235703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 181/370] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.235939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 190/371] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.235939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.239998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.361151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99317-6e6c-4ff1-938e-d072f8a6fabe None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.364740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b33f4-cf1b-474c-96e6-76aeb9b84b62 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.398966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.405491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.405784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605203-66b1-4f1e-81da-f921c5606933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.406171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.406335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605203-66b1-4f1e-81da-f921c5606933 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.406481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605203-66b1-4f1e-81da-f921c5606933 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.406623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.406792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605203-66b1-4f1e-81da-f921c5606933 None admin] PATH_INFO: `/v3/groups/4c71f74602a246c9af54b628cebeb34e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.406954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] PATH_INFO: `/v3/users/c257ce80f1744b55a6d150396e84176d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.408273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] RBAC: Authorizing `identity:get_user(user_id=c257ce80f1744b55a6d150396e84176d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.409834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.412025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 191/372] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/users/c257ce80f1744b55a6d150396e84176d => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.412220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22605203-66b1-4f1e-81da-f921c5606933 None admin] RBAC: Authorizing `identity:get_group(group_id=4c71f74602a246c9af54b628cebeb34e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.413449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.414124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22605203-66b1-4f1e-81da-f921c5606933 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.424474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 182/373] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/groups/4c71f74602a246c9af54b628cebeb34e => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.424474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419e9b-5a74-479c-be45-abfe9ca0fcc6 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.424474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419e9b-5a74-479c-be45-abfe9ca0fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.424474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419e9b-5a74-479c-be45-abfe9ca0fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.439416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-09419e9b-5a74-479c-be45-abfe9ca0fcc6 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:04.440832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-09419e9b-5a74-479c-be45-abfe9ca0fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:04.492557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.544305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9f5d4-d031-47f4-ae01-4209cfd1216f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.559900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 183/374] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:04.561424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09419e9b-5a74-479c-be45-abfe9ca0fcc6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.593358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.593973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.594261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.594539 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.595304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=773a7d5487cb4873aa7623c2ce26c411) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:04.595620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.597067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.614669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 192/375] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.614669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.750005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbbcf-0852-4248-9b1d-82789ec1aafb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.772774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09419e9b-5a74-479c-be45-abfe9ca0fcc6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.787196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.794478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.795250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.795608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.795955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.797331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=341040ab922c4a298485eb1262890305, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:04.797331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.799322 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.807675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 193/376] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=341040ab922c4a298485eb1262890305 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.808193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.824229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.845064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.847369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.848222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.848955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.943527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4d6e-6f9a-47ea-8780-cba7812acd5a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.994878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.998278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:05.014412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:05.015430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.015923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.016467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.018004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] RBAC: Adding query filter params (role.id=1c7e596fa48049ea87bc3896af945fa1, user.id=c257ce80f1744b55a6d150396e84176d, scope.system=all) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:05.018537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:05.021188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:05.044534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 194/377] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/role_assignments?user.id=c257ce80f1744b55a6d150396e84176d&scope.system=all&role.id=1c7e596fa48049ea87bc3896af945fa1 => generated 510 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:05.045982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:05.157770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:05.266063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f47a45-3917-4916-b859-766fa0581d4e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:05.329524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 184/378] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:05.330845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:05.357767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:05.358424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.358739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.359022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.359793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] RBAC: Adding query filter params (group.id=4c71f74602a246c9af54b628cebeb34e, role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=036067fc874c4d13970eee6f98f3d00e) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:05.360105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:05.361719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:05.377563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 195/379] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:05 2022] GET /identity/v3/role_assignments?group.id=4c71f74602a246c9af54b628cebeb34e&scope.project.id=036067fc874c4d13970eee6f98f3d00e&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 260 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:05.378574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:05.388986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:05.629780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec936f0-6cea-4c47-8e6a-2f7aa158577b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:05.667043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f914b-919c-499e-8afe-6f03c66ada89 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:05.712101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:05.739794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:05.742561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.743365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.744040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.749217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:05.750536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.751195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.751802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.754558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:05.758939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:05.767187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 196/380] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:05 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:05.773703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:05.792263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:05.806710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:05.808592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:05.810218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:05.814217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 185/381] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:05.821794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.048047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.058329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacde7-3328-4992-9d3d-d1a3b6b4c9ee None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.081107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf18cc-2a10-4d41-af3d-a1ceaa244c09 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.128895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.129552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.129834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.130113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.133115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.134580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.138581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 197/382] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:05 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:06.148366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.167339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.167973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.168247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.168522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.169203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:06.169508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.170936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.188351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 186/383] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:06.200227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.281839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.391555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135ae0-ec90-4d4a-80ce-83e2f72e5ddb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.419178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540569e7-d037-44d2-a29f-78e263297f70 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.470224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.471318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.471820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.472445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.473937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=341040ab922c4a298485eb1262890305, scope.project.id=773a7d5487cb4873aa7623c2ce26c411) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:06.474481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.478606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.488068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.488725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.489011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.489267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.494184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.495705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.497394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 187/384] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:06 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:06.499863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 198/385] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:06 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=341040ab922c4a298485eb1262890305 => generated 260 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:06.505788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.536895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.749001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc8fe5-e0e8-4d44-a01d-a036a0807baa None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.808454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb118e33-6ec3-43a5-b7b4-ff44130807a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.809125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118e33-6ec3-43a5-b7b4-ff44130807a4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.809407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118e33-6ec3-43a5-b7b4-ff44130807a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.809685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118e33-6ec3-43a5-b7b4-ff44130807a4 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.815733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb118e33-6ec3-43a5-b7b4-ff44130807a4 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.817240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb118e33-6ec3-43a5-b7b4-ff44130807a4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.819376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 188/386] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:06 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:06.829041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.951780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa6eeb-c3e4-4ad0-ad3f-01345e52b034 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.972229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.998569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eeb7f-f1cb-45bd-bbcc-670f0dfa052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.999313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eeb7f-f1cb-45bd-bbcc-670f0dfa052c None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.999596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eeb7f-f1cb-45bd-bbcc-670f0dfa052c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.999877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eeb7f-f1cb-45bd-bbcc-670f0dfa052c None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/groups/ab29dc40249b402b95623dff20388735/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.001899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eeb7f-f1cb-45bd-bbcc-670f0dfa052c None admin] RBAC: Authorizing `identity:create_grant(project_id=f43f4ccbeef34f9c9e06a711f6e66e64, group_id=ab29dc40249b402b95623dff20388735, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:07.003583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eeb7f-f1cb-45bd-bbcc-670f0dfa052c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:07.096287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 199/387] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:06 2022] PUT /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/groups/ab29dc40249b402b95623dff20388735/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:07.953812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7750f2-5621-4efa-a2f9-3026f7fbb2e8 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.954825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7750f2-5621-4efa-a2f9-3026f7fbb2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.954825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7750f2-5621-4efa-a2f9-3026f7fbb2e8 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.955991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 189/388] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:00:07.965033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b28982-1b19-4ff1-8ec8-9cbdda61af60 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.965407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b28982-1b19-4ff1-8ec8-9cbdda61af60 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.965641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b28982-1b19-4ff1-8ec8-9cbdda61af60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.986126 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-04b28982-1b19-4ff1-8ec8-9cbdda61af60 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:07.991834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04b28982-1b19-4ff1-8ec8-9cbdda61af60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:08.088323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 200/389] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:08.604443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6671b-d880-4c79-80c6-cca6733dec0d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.605392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6671b-d880-4c79-80c6-cca6733dec0d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.606122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6671b-d880-4c79-80c6-cca6733dec0d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.609153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 190/390] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:00:08.614059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b0989-4a8d-4f47-8e39-407d16aae88b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.614867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b0989-4a8d-4f47-8e39-407d16aae88b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.614867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b0989-4a8d-4f47-8e39-407d16aae88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.637611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0c0b0989-4a8d-4f47-8e39-407d16aae88b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:08.642881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0c0b0989-4a8d-4f47-8e39-407d16aae88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:08.708650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6671b-d880-4c79-80c6-cca6733dec0d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:08.799725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 201/391] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:08.929034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:08.981334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6671b-d880-4c79-80c6-cca6733dec0d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:09.059776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:09.060834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.061335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.061816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.092167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:09.105114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:09.106032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:09.106937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:09.108003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 191/392] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:09.116955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b0989-4a8d-4f47-8e39-407d16aae88b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:09.215325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:09.229131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:09.328147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b0989-4a8d-4f47-8e39-407d16aae88b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:09.375101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07706515-960a-4b18-a30b-f660ab4725d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:09.376081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07706515-960a-4b18-a30b-f660ab4725d9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.376368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07706515-960a-4b18-a30b-f660ab4725d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.376646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07706515-960a-4b18-a30b-f660ab4725d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.377338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07706515-960a-4b18-a30b-f660ab4725d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:09.377644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07706515-960a-4b18-a30b-f660ab4725d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:09.379066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07706515-960a-4b18-a30b-f660ab4725d9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:09.390522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 202/393] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:09.392276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c94f5-2c84-4d71-94c2-763a1da431c9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.392567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c94f5-2c84-4d71-94c2-763a1da431c9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.392848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c94f5-2c84-4d71-94c2-763a1da431c9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.398744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 203/394] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:09.400607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c94f5-2c84-4d71-94c2-763a1da431c9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:09.420621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a9a1-d1fa-4902-9dd5-15af8d455dc9 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:09.457656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ce2f-18bf-463a-ba2f-2a3ceaebd661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:09.458307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce2f-18bf-463a-ba2f-2a3ceaebd661 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.458591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce2f-18bf-463a-ba2f-2a3ceaebd661 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.458893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce2f-18bf-463a-ba2f-2a3ceaebd661 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.471638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142ce2f-18bf-463a-ba2f-2a3ceaebd661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-8142ce2f-18bf-463a-ba2f-2a3ceaebd661 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:09.477432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:09.479601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 192/395] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:09.481569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35781b-ac43-4d24-bd1c-9fa6c07d2e41 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.483307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35781b-ac43-4d24-bd1c-9fa6c07d2e41 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.483307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35781b-ac43-4d24-bd1c-9fa6c07d2e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.490945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:09.514874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0b35781b-ac43-4d24-bd1c-9fa6c07d2e41 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:09.518276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0b35781b-ac43-4d24-bd1c-9fa6c07d2e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:09.577847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:09.583475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c94f5-2c84-4d71-94c2-763a1da431c9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:09.630678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 193/396] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:09.630678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35781b-ac43-4d24-bd1c-9fa6c07d2e41 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:09.644663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d906eb1-d270-4ba5-9d03-4bfaff880fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:09.646271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906eb1-d270-4ba5-9d03-4bfaff880fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.647179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906eb1-d270-4ba5-9d03-4bfaff880fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.647570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906eb1-d270-4ba5-9d03-4bfaff880fd0 None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.648965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d906eb1-d270-4ba5-9d03-4bfaff880fd0 None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:09.650423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d906eb1-d270-4ba5-9d03-4bfaff880fd0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:09.658757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 204/397] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:09 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:09.658757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024961e-c3c3-4038-a94b-3aeba2d4a7a1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.658757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024961e-c3c3-4038-a94b-3aeba2d4a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.658757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024961e-c3c3-4038-a94b-3aeba2d4a7a1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.658757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 205/398] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:09.665821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024961e-c3c3-4038-a94b-3aeba2d4a7a1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:09.783931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35781b-ac43-4d24-bd1c-9fa6c07d2e41 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:09.854356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:09.861341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024961e-c3c3-4038-a94b-3aeba2d4a7a1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:09.869394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c2f40-b7f9-48a2-9aeb-777c64b7d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:09.871034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2f40-b7f9-48a2-9aeb-777c64b7d48c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.872929 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2f40-b7f9-48a2-9aeb-777c64b7d48c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.873792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2f40-b7f9-48a2-9aeb-777c64b7d48c None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.875475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c2f40-b7f9-48a2-9aeb-777c64b7d48c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:09.875783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c2f40-b7f9-48a2-9aeb-777c64b7d48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:09.877181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c2f40-b7f9-48a2-9aeb-777c64b7d48c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:09.888722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 194/399] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:09.890254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbd2c5-0c7b-43de-a946-9d04f5f3a9d5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.890539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbd2c5-0c7b-43de-a946-9d04f5f3a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.890864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbd2c5-0c7b-43de-a946-9d04f5f3a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.915464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-36fbd2c5-0c7b-43de-a946-9d04f5f3a9d5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:09.916916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-36fbd2c5-0c7b-43de-a946-9d04f5f3a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:09.934943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:09.935595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.935871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.936140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.937284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:09.938755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:09.946661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 206/400] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:09 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:09.946661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:09.986417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:10.073175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c35b9-f946-4128-8d67-e71abc2dfef4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:10.073784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 195/401] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:10.076204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbd2c5-0c7b-43de-a946-9d04f5f3a9d5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:10.108399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:10.109389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.109389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.109672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.110703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:10.112149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:10.119273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 207/402] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:09 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:10.123375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:10.245822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787b5e2-d2d3-4de2-8e19-15fa9c391669 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:10.247807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:10.290488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:10.291187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.291471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.292020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.293356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:10.295059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:10.302235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 208/403] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:10 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:10.302235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:10.302457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbd2c5-0c7b-43de-a946-9d04f5f3a9d5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:10.339210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:10.352290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:10.353395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.353395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.353661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411/groups/ab29dc40249b402b95623dff20388735/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.355594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] RBAC: Authorizing `identity:create_grant(project_id=773a7d5487cb4873aa7623c2ce26c411, group_id=ab29dc40249b402b95623dff20388735, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:10.357030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:10.413993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e54d9-b516-41b7-b9b4-f9a590186374 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:10.450198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86caf8-8f90-4200-9f10-ddffb0db5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:10.450868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86caf8-8f90-4200-9f10-ddffb0db5738 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.451142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86caf8-8f90-4200-9f10-ddffb0db5738 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.451418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86caf8-8f90-4200-9f10-ddffb0db5738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.462006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86caf8-8f90-4200-9f10-ddffb0db5738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ef86caf8-8f90-4200-9f10-ddffb0db5738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:10.466818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:10.468465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 209/404] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:10.470037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe791db4-0bf9-45a7-8c24-88521b75fd87 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.471425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe791db4-0bf9-45a7-8c24-88521b75fd87 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.471425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe791db4-0bf9-45a7-8c24-88521b75fd87 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.472714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 210/405] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:10.472714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe791db4-0bf9-45a7-8c24-88521b75fd87 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:10.491285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 196/406] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:10 2022] PUT /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411/groups/ab29dc40249b402b95623dff20388735/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:10.496700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:10.517051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:10.630583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe791db4-0bf9-45a7-8c24-88521b75fd87 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:10.646205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e156-0b7b-4e5e-8d7d-323d0a11f416 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:10.692372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:10.693187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.693785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.693785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/groups/ab29dc40249b402b95623dff20388735/roles/341040ab922c4a298485eb1262890305` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.694702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb617acc-ac2e-44bc-b00d-a65c625e3eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:10.695398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb617acc-ac2e-44bc-b00d-a65c625e3eaf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.695743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb617acc-ac2e-44bc-b00d-a65c625e3eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.696103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb617acc-ac2e-44bc-b00d-a65c625e3eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.696278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] RBAC: Authorizing `identity:create_grant(project_id=f43f4ccbeef34f9c9e06a711f6e66e64, group_id=ab29dc40249b402b95623dff20388735, role_id=341040ab922c4a298485eb1262890305)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:10.696868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb617acc-ac2e-44bc-b00d-a65c625e3eaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:10.697236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb617acc-ac2e-44bc-b00d-a65c625e3eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:10.697575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:10.698793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb617acc-ac2e-44bc-b00d-a65c625e3eaf None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:10.709650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 197/407] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:10.712293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc86ff-befd-4e5b-bf8a-8bf96b93416d None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.712813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc86ff-befd-4e5b-bf8a-8bf96b93416d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.713295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc86ff-befd-4e5b-bf8a-8bf96b93416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.743241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-08fc86ff-befd-4e5b-bf8a-8bf96b93416d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:10.745014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-08fc86ff-befd-4e5b-bf8a-8bf96b93416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:10.822655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:10.826773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 211/408] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:10 2022] PUT /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64/groups/ab29dc40249b402b95623dff20388735/roles/341040ab922c4a298485eb1262890305 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:10.828666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:10.907232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 198/409] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:10.908933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc86ff-befd-4e5b-bf8a-8bf96b93416d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.025324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:11.058662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b518580-daf5-4b47-a64f-66f154292ece None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.121497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:11.122613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:11.123153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:11.123717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:11.148426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:11.160265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:11.161861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:11.164115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:11.166838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 212/410] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:11.172863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.245681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc86ff-befd-4e5b-bf8a-8bf96b93416d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.375425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:11.376089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:11.376364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:11.376633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] PATH_INFO: `/v3/groups/4c71f74602a246c9af54b628cebeb34e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:11.377862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] RBAC: Authorizing `identity:get_group(group_id=4c71f74602a246c9af54b628cebeb34e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:11.379345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:11.382477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 199/411] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:10 2022] GET /identity/v3/groups/4c71f74602a246c9af54b628cebeb34e => generated 229 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:11.386078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c181c-e645-4627-89c1-b6768c6984e7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.390396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.492491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:11.493413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:11.493902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:11.494385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:11.495641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:11.496180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:11.507033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:11.514946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:11.532965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 213/412] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:11.540689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.587137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:11.628073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c77b8-aa66-428a-9ed3-809ee0b7f5ab None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.701600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:11.702733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:11.703229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:11.704221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] PATH_INFO: `/v3/projects/036067fc874c4d13970eee6f98f3d00e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:11.705872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] RBAC: Authorizing `identity:get_project(project_id=036067fc874c4d13970eee6f98f3d00e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:11.708781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:11.712557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 200/413] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:11 2022] GET /identity/v3/projects/036067fc874c4d13970eee6f98f3d00e => generated 344 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:11.714022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.747999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c22aa-e0c7-4814-8d80-953c8bacbf31 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.806162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:11.807679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:11.808219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:11.808672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:11.810618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:11.812927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:11.821065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 214/414] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:11 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:11.821065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.941281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bbc7-7876-4b4b-911c-2a9fd92ae852 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.969600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:11.988975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:12.011988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.013603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.014581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.015373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.030425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11cd2-2fa1-4db2-822b-4fe9a3699162 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:12.040268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:12.052325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:12.054320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:12.055875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 201/415] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:12.058078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:12.109034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.109719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.109998 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.110270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] PATH_INFO: `/v3/projects/036067fc874c4d13970eee6f98f3d00e/groups/4c71f74602a246c9af54b628cebeb34e/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.112416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] RBAC: Authorizing `identity:create_grant(project_id=036067fc874c4d13970eee6f98f3d00e, group_id=4c71f74602a246c9af54b628cebeb34e, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:12.113914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:12.211995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 215/416] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:11 2022] PUT /identity/v3/projects/036067fc874c4d13970eee6f98f3d00e/groups/4c71f74602a246c9af54b628cebeb34e/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:12.214286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:12.325745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d9d9e-6666-4468-8a78-7f19d19ecf5e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:12.448899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.450527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.451478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.451981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.454752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:12.457532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:12.464945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 202/417] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:12 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:12.474535 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:12.483151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda027-8559-431b-bd53-910b6445c325 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:12.547085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.548072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.548571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.549041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.549909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:12.550430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:12.557236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:12.577293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 216/418] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:12.580661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:12.584380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:12.587780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:12.694652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11326e-15f4-4a1f-9cbb-7c9d4ee5c166 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:12.736619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.737295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.737574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.737847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411/groups/ab29dc40249b402b95623dff20388735/roles/341040ab922c4a298485eb1262890305` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.741902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] RBAC: Authorizing `identity:create_grant(project_id=773a7d5487cb4873aa7623c2ce26c411, group_id=ab29dc40249b402b95623dff20388735, role_id=341040ab922c4a298485eb1262890305)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:12.743526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:12.802914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740e89-0b6b-4322-8ae8-f97c8ca7517f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:12.815998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 203/419] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:12 2022] PUT /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411/groups/ab29dc40249b402b95623dff20388735/roles/341040ab922c4a298485eb1262890305 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:00:12.856877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.857511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.857793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.858067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.964765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:12.966251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:12.968840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:13.098273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 217/420] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:13.104910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.239616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:13.245749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1694a-d803-404f-b93f-9bb20bdf33bc None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:13.299242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:13.299905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.300186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.300521 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.304874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:13.307102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:13.309759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 204/421] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:13.317033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.438861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e42450-142a-45b1-b681-c781dd7ddb53 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:13.440561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:13.479427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d187a-f724-4bbe-9748-831d8c7e86ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:13.480081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d187a-f724-4bbe-9748-831d8c7e86ef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.480361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d187a-f724-4bbe-9748-831d8c7e86ef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.480632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d187a-f724-4bbe-9748-831d8c7e86ef None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.481801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d187a-f724-4bbe-9748-831d8c7e86ef None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:13.483292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d187a-f724-4bbe-9748-831d8c7e86ef None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:13.485245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 218/422] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:13.492665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.635860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad2e00-38e3-48ea-af75-9b0d42026d8b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:13.713747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f2ee-a453-48f5-a8c6-d18b0cf745cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:13.714382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f2ee-a453-48f5-a8c6-d18b0cf745cc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.714690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f2ee-a453-48f5-a8c6-d18b0cf745cc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.714968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f2ee-a453-48f5-a8c6-d18b0cf745cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.715705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f2ee-a453-48f5-a8c6-d18b0cf745cc None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:13.716009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f2ee-a453-48f5-a8c6-d18b0cf745cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:13.717544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f2ee-a453-48f5-a8c6-d18b0cf745cc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:13.730480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 205/423] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:13.879439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e15afa-745f-4729-a8cd-69a97eaa2e7f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.880206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e15afa-745f-4729-a8cd-69a97eaa2e7f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.880206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e15afa-745f-4729-a8cd-69a97eaa2e7f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.883417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 219/424] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:13.889606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a6e9-9767-4719-ac26-21bf81cd088c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.890052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a6e9-9767-4719-ac26-21bf81cd088c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.890456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a6e9-9767-4719-ac26-21bf81cd088c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.923885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d0a0a6e9-9767-4719-ac26-21bf81cd088c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:13.925179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d0a0a6e9-9767-4719-ac26-21bf81cd088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:13.963816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.024484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 206/425] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:14.027289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1403d3-547e-40c6-8902-688a4ab21edd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.027756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1403d3-547e-40c6-8902-688a4ab21edd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.028243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1403d3-547e-40c6-8902-688a4ab21edd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.031104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 220/426] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:14.039951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523d74-d108-42ea-be3d-552d217108aa None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.040221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523d74-d108-42ea-be3d-552d217108aa None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.040479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523d74-d108-42ea-be3d-552d217108aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.064247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2a523d74-d108-42ea-be3d-552d217108aa None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:14.065510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2a523d74-d108-42ea-be3d-552d217108aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:14.152584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 207/427] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:14.396572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1403d3-547e-40c6-8902-688a4ab21edd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.501034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523d74-d108-42ea-be3d-552d217108aa None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.549948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1403d3-547e-40c6-8902-688a4ab21edd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.592616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.593272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.593551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.593824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.607107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:14.612238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:14.614596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:14.616915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 221/428] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:14.622688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.662289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.681981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.691288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523d74-d108-42ea-be3d-552d217108aa None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.730280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.731004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.731283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.731545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.744589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:14.749693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:14.751593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:14.753382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:14.754906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c8bb-2317-408b-baff-f6e0570e8c02 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.755156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 208/429] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:14.759408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.805512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.806147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.806430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.807907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.809039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:14.809346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:14.811481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:14.825664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 222/430] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:14.832854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.945712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d46818-e784-4107-8a26-943d2d849ef2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.993785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.994415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.994774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.995054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.995774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:14.996050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:14.997451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.014146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 209/431] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:15.023724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.047896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.063369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f61584-8ee5-45f0-b747-a1ba80bc94b5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.082388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.120213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfb047-1336-4490-b46e-e44629a8c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.121736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb047-1336-4490-b46e-e44629a8c045 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.122517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb047-1336-4490-b46e-e44629a8c045 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.123372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb047-1336-4490-b46e-e44629a8c045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.158863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e56a-3ec7-4f1f-a425-fa810920577d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.211433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b2266-2431-4e10-a9cd-2087137fa4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.212481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b2266-2431-4e10-a9cd-2087137fa4ff None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.212782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b2266-2431-4e10-a9cd-2087137fa4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.213063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b2266-2431-4e10-a9cd-2087137fa4ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.219536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfb047-1336-4490-b46e-e44629a8c045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.221054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfb047-1336-4490-b46e-e44629a8c045 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.298980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b2266-2431-4e10-a9cd-2087137fa4ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.298980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b2266-2431-4e10-a9cd-2087137fa4ff None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.315504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.358744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.376646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 223/432] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:15.378175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312e91-960f-41f6-8f9e-d2e286d50184 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.378465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312e91-960f-41f6-8f9e-d2e286d50184 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.379870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312e91-960f-41f6-8f9e-d2e286d50184 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.380408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 224/433] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:15.386681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312e91-960f-41f6-8f9e-d2e286d50184 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.454811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 210/434] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 20:00:15.456319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41f3a8-970a-4208-a689-1b649dbeeca3 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.456723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41f3a8-970a-4208-a689-1b649dbeeca3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.457099 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41f3a8-970a-4208-a689-1b649dbeeca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.477245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5e41f3a8-970a-4208-a689-1b649dbeeca3 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:15.478512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5e41f3a8-970a-4208-a689-1b649dbeeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:15.540301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312e91-960f-41f6-8f9e-d2e286d50184 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.594880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 211/435] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:15.594880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41f3a8-970a-4208-a689-1b649dbeeca3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.599340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.602383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.603041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.603565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.605630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.608829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.618524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 225/436] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:15.622373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.681691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.759003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.796944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41f3a8-970a-4208-a689-1b649dbeeca3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.825226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0e0-8473-406c-ac13-56a8533fa182 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.861264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.862778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.863494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.864333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] PATH_INFO: `/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.867292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] RBAC: Authorizing `identity:get_project(project_id=f43f4ccbeef34f9c9e06a711f6e66e64)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.869832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.878496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 212/437] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/projects/f43f4ccbeef34f9c9e06a711f6e66e64 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:15.880079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.901099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.901742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.902022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.902292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.903493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.905205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.906873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 226/438] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:15.912704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.993323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b493-e657-4a2a-8d7b-c99186917b95 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.009223 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.037809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2e050-afb3-4b43-b71e-0f3bc13eb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.038673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e050-afb3-4b43-b71e-0f3bc13eb114 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.038964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e050-afb3-4b43-b71e-0f3bc13eb114 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.039241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e050-afb3-4b43-b71e-0f3bc13eb114 None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.041206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2e050-afb3-4b43-b71e-0f3bc13eb114 None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.044014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2e050-afb3-4b43-b71e-0f3bc13eb114 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.047413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 213/439] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.049434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a157b-0e74-4f37-a94d-33c2aae20525 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.049908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a157b-0e74-4f37-a94d-33c2aae20525 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.050366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a157b-0e74-4f37-a94d-33c2aae20525 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.054664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 214/440] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:16.054664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a157b-0e74-4f37-a94d-33c2aae20525 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.065520 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2263e-304c-417b-910e-88a6008d6e00 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.101229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.115127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.115127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.115127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.115127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.126772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:16.131371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:16.132530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:16.133292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:16.137398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 227/441] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:16.138324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.189947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a157b-0e74-4f37-a94d-33c2aae20525 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.238966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ed2d3-00bc-4b5f-b502-dbfd91c938e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.240009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ed2d3-00bc-4b5f-b502-dbfd91c938e1 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.240516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ed2d3-00bc-4b5f-b502-dbfd91c938e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.241049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ed2d3-00bc-4b5f-b502-dbfd91c938e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.242395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ed2d3-00bc-4b5f-b502-dbfd91c938e1 None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=f4d54ec4c8844bc6a93b694e46f8da14, scope.project.id=773a7d5487cb4873aa7623c2ce26c411) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:16.243007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ed2d3-00bc-4b5f-b502-dbfd91c938e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.245760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ed2d3-00bc-4b5f-b502-dbfd91c938e1 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.254188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 215/442] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=f4d54ec4c8844bc6a93b694e46f8da14 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.255469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ff7f-6a57-44a3-a6fc-6aae183017ec None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.255826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ff7f-6a57-44a3-a6fc-6aae183017ec None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.256127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ff7f-6a57-44a3-a6fc-6aae183017ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.261465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6b108-387c-4148-92d3-5a99cd5ff7f1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.287899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c282ff7f-6a57-44a3-a6fc-6aae183017ec None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:16.292421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c282ff7f-6a57-44a3-a6fc-6aae183017ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:16.309826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.310469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.310841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.311641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.312445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=341040ab922c4a298485eb1262890305, scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:16.312768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.314307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.325075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 228/443] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=f43f4ccbeef34f9c9e06a711f6e66e64&role.id=341040ab922c4a298485eb1262890305 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.325981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.364573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.423848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 216/444] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:16.439430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.511010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd291f8-5229-40c3-b84b-16ffc2c25de4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.556566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.557201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.557476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.557756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.558435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:16.558807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.560255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.571630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 229/445] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.581759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ff7f-6a57-44a3-a6fc-6aae183017ec None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.701219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.718121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ff7f-6a57-44a3-a6fc-6aae183017ec None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.764585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.765219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.765506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.765785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.827548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.868742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880ada-5b39-450d-81a4-fa36374d2634 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.879037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.881787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.895623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.928781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.931166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.931166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.931659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.950897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:16.956290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:16.957651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 230/446] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:16.969405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.049408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 217/447] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:17.056383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.120270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050950-9a97-44ed-8752-46375ec16128 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.160775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.169471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.170445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.170959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.171407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.172517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:17.173021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.175212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.188350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 231/448] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:17.195352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.200307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405ba5-96aa-4e9e-9246-1cab5f899adb None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.237959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.248033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.248693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.248968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.249335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] PATH_INFO: `/v3/projects/036067fc874c4d13970eee6f98f3d00e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.252049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] RBAC: Authorizing `identity:get_project(project_id=036067fc874c4d13970eee6f98f3d00e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.252337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.254070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 218/449] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/projects/036067fc874c4d13970eee6f98f3d00e => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:17.260557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.330826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d287d-3c4e-4ba7-afa1-abcd185bd4cf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.386815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.387785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.388238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.388689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.404682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acfbbb-0212-4812-bdb0-0f8ca0c16618 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.453879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.454438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.454747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.455025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] PATH_INFO: `/v3/groups/4c71f74602a246c9af54b628cebeb34e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.456207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] RBAC: Authorizing `identity:get_group(group_id=4c71f74602a246c9af54b628cebeb34e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.457666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.459643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 219/450] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/groups/4c71f74602a246c9af54b628cebeb34e => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:17.465736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.476185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.477639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.480254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.516018 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.581393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64c367-c017-48b2-96ce-6ee8dba3f8b4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.590768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 232/451] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 20:00:17.596626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.622125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.622816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.623095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.623367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.624118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] RBAC: Adding query filter params (group.id=4c71f74602a246c9af54b628cebeb34e, role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=036067fc874c4d13970eee6f98f3d00e) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:17.624424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.625926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.633525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 220/452] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/role_assignments?group.id=4c71f74602a246c9af54b628cebeb34e&scope.project.id=036067fc874c4d13970eee6f98f3d00e&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:17.721294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211c82-b8b8-48c1-9947-0fcda55ab525 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.761654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.762317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.762594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.762901 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] PATH_INFO: `/v3/projects/773a7d5487cb4873aa7623c2ce26c411` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.764173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] RBAC: Authorizing `identity:get_project(project_id=773a7d5487cb4873aa7623c2ce26c411)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.765674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.767443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 233/453] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/projects/773a7d5487cb4873aa7623c2ce26c411 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:17.774425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.862149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.887141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4110ce1-5dea-4b2e-9a4a-41c06b56485f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.923220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aa981-7aa7-4153-9d7f-ffb6b3cdc718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.923850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa981-7aa7-4153-9d7f-ffb6b3cdc718 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.924129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa981-7aa7-4153-9d7f-ffb6b3cdc718 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.924399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa981-7aa7-4153-9d7f-ffb6b3cdc718 None admin] PATH_INFO: `/v3/groups/ab29dc40249b402b95623dff20388735` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.925498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aa981-7aa7-4153-9d7f-ffb6b3cdc718 None admin] RBAC: Authorizing `identity:get_group(group_id=ab29dc40249b402b95623dff20388735)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.926961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aa981-7aa7-4153-9d7f-ffb6b3cdc718 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.928758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 221/454] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/groups/ab29dc40249b402b95623dff20388735 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:17.934757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.938695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:18.038768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43194-df2f-4581-8f54-f2075f915a44 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:18.074125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0a3f-7afa-43a0-aa7c-42c4588c2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:18.074776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0a3f-7afa-43a0-aa7c-42c4588c2188 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:18.075059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0a3f-7afa-43a0-aa7c-42c4588c2188 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:18.075332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0a3f-7afa-43a0-aa7c-42c4588c2188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:18.076088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0a3f-7afa-43a0-aa7c-42c4588c2188 None admin] RBAC: Adding query filter params (group.id=ab29dc40249b402b95623dff20388735, role.id=341040ab922c4a298485eb1262890305, scope.project.id=773a7d5487cb4873aa7623c2ce26c411) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:18.076404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0a3f-7afa-43a0-aa7c-42c4588c2188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:18.078012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0a3f-7afa-43a0-aa7c-42c4588c2188 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:18.086156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 234/455] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/role_assignments?group.id=ab29dc40249b402b95623dff20388735&scope.project.id=773a7d5487cb4873aa7623c2ce26c411&role.id=341040ab922c4a298485eb1262890305 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:20.828844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2f5d3-8fd0-409e-8a8d-08d786451433 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.829703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2f5d3-8fd0-409e-8a8d-08d786451433 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.829703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2f5d3-8fd0-409e-8a8d-08d786451433 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.831262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 222/456] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:20.837830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478345-a3f2-4647-be9f-11179e91e0b0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.838593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478345-a3f2-4647-be9f-11179e91e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.838593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478345-a3f2-4647-be9f-11179e91e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.867874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-83478345-a3f2-4647-be9f-11179e91e0b0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:20.870362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-83478345-a3f2-4647-be9f-11179e91e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:20.969717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:20.976745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 235/457] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:21.564903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2f5d3-8fd0-409e-8a8d-08d786451433 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:21.784594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2f5d3-8fd0-409e-8a8d-08d786451433 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:21.785243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a9f9-d460-49d1-a415-774146426223 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.785736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a9f9-d460-49d1-a415-774146426223 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.786224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a9f9-d460-49d1-a415-774146426223 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.789246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 236/458] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:21.797507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b57d4-f165-4b93-b889-5ecfa0c25e93 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.797958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b57d4-f165-4b93-b889-5ecfa0c25e93 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.798431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b57d4-f165-4b93-b889-5ecfa0c25e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.866665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-816b57d4-f165-4b93-b889-5ecfa0c25e93 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:21.867667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-816b57d4-f165-4b93-b889-5ecfa0c25e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:21.875434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ee92c-1583-4e2e-85e3-a74500a1ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:21.876544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ee92c-1583-4e2e-85e3-a74500a1ab36 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.877033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ee92c-1583-4e2e-85e3-a74500a1ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.877514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ee92c-1583-4e2e-85e3-a74500a1ab36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.914798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ee92c-1583-4e2e-85e3-a74500a1ab36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:21.917590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ee92c-1583-4e2e-85e3-a74500a1ab36 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:21.927103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-015ee92c-1583-4e2e-85e3-a74500a1ab36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:21.953114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:21.955192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:21.957172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:21.957172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:21.957172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:21.960615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 223/459] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:21.963276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a191e-3e6d-4c4e-927d-c3166c2dedab None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.963922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a191e-3e6d-4c4e-927d-c3166c2dedab None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.964469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a191e-3e6d-4c4e-927d-c3166c2dedab None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.967187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 224/460] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:21.968613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a191e-3e6d-4c4e-927d-c3166c2dedab None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.030745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 237/461] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:22.034709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d4d02-7832-4fa1-8e59-3305b85baa4e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.035973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d4d02-7832-4fa1-8e59-3305b85baa4e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.037114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d4d02-7832-4fa1-8e59-3305b85baa4e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.040922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 238/462] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:22.043939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeedda-2d42-44e7-bebd-3351ed004d7c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.044644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeedda-2d42-44e7-bebd-3351ed004d7c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.045307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeedda-2d42-44e7-bebd-3351ed004d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.078281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ddbeedda-2d42-44e7-bebd-3351ed004d7c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:22.079221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ddbeedda-2d42-44e7-bebd-3351ed004d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:22.138907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a191e-3e6d-4c4e-927d-c3166c2dedab None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.161435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 239/463] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:22.167998 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0caa-6f52-4c26-ac66-b96e3bb43b1a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.168388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0caa-6f52-4c26-ac66-b96e3bb43b1a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.169406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0caa-6f52-4c26-ac66-b96e3bb43b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.203752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d8ff0caa-6f52-4c26-ac66-b96e3bb43b1a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:22.205145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8ff0caa-6f52-4c26-ac66-b96e3bb43b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:22.207615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.209457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.210272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.211089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.212732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:22.213585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.216529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.241559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 225/464] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:22.251694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.343739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.360074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 240/465] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:22.368007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0caa-6f52-4c26-ac66-b96e3bb43b1a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.397494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.488322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04f9d9-70a2-44d1-b90f-13d492d6625f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.556191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.557960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.558425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.558890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.559747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0caa-6f52-4c26-ac66-b96e3bb43b1a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.559949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.562078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.604625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.606380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.606380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.606380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.619312 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.620871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:22.639061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:22.647984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:22.648842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:22.648842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:22.648842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:22.648842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 241/466] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:22.648842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.686776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 226/467] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:22 2022] POST /identity/v3/users => generated 248 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:22.687618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.723327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.897694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d875-0fb5-4ae7-981f-f53541794026 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.945557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.946131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.946418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.946737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.951474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22cd3-fd9f-4acb-8f4e-750b1d1d183c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.961531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.963075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.977438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:22.982413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:22.984286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:22.985910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:22.985910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:22.985910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:22.985910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 242/468] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:22.985910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.043235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.044361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.044940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.045500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.047908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:23.048516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.051119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.081329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 227/469] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:23.082371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.156561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.180856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a61ccf-cad8-4e2d-9105-d6d5798997bc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.224570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ddb3c-1ae9-4fdd-994a-1364f89450ab None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.268416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.269045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.269331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.269611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.270273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:23.270584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.272319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.283077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.285778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.287183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.287967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.288551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 228/470] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:23.289456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.321914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.323567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:23.340179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:23.341887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:23.350884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:23.350884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:23.350884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:23.350884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 243/471] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:23.350884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.354916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.439771 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64117978-8c19-469c-a181-9f09264e74ca None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.512666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246b66e-3159-4da1-afa3-61eb81f6cc7c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.514177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.515259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.516828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.516828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.517400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.520164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.558150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b2485-004a-4926-b3db-84a01b38c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.558867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2485-004a-4926-b3db-84a01b38c9c0 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.559212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2485-004a-4926-b3db-84a01b38c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.559530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2485-004a-4926-b3db-84a01b38c9c0 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.560282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b2485-004a-4926-b3db-84a01b38c9c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.561852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b2485-004a-4926-b3db-84a01b38c9c0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.639037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 229/472] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:23 2022] POST /identity/v3/users => generated 246 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:23.640156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.664960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.699650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 244/473] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:23 2022] POST /identity/v3/users => generated 249 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:23.699650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd49424-a6fa-4f60-81f1-51be33c6ed2a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.699650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd49424-a6fa-4f60-81f1-51be33c6ed2a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.699650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd49424-a6fa-4f60-81f1-51be33c6ed2a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.703587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 245/474] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:23.713964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef70e6-26df-4127-98ca-d01bb71bf144 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.716167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef70e6-26df-4127-98ca-d01bb71bf144 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.717189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef70e6-26df-4127-98ca-d01bb71bf144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.782353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b9ef70e6-26df-4127-98ca-d01bb71bf144 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:23.784524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b9ef70e6-26df-4127-98ca-d01bb71bf144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:23.919130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 246/475] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:23.928052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.946430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eb8ea-32e8-4d85-8341-d488cce1ff55 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.991920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.992920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.992920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.993235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.993704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:23.994014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.995462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:24.012155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 230/476] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:24.016700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef70e6-26df-4127-98ca-d01bb71bf144 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:24.148803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef70e6-26df-4127-98ca-d01bb71bf144 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:24.208240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:24.227707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00219f37-4523-40d3-83db-70513e076462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:24.228841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219f37-4523-40d3-83db-70513e076462 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:24.229323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219f37-4523-40d3-83db-70513e076462 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:24.229823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219f37-4523-40d3-83db-70513e076462 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:24.231055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00219f37-4523-40d3-83db-70513e076462 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:24.239650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00219f37-4523-40d3-83db-70513e076462 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:24.347180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 247/477] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:24 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:24.422710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:24.584663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c573e-201b-4100-b32c-f8b4c70df229 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:24.626783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:24.627407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:24.627743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:24.628021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:24.628772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:24.630151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:24.666676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.sql.core [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 20:00:24.666676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 20:00:24.666676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [parameters: {'id': '177272b9dd624329b31690d18801329b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 20:00:24.666676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81779) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result.read() Aug 17 20:00:24.684186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:00:24.685206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application yield resource Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise self.value Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application session.commit() Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 20:00:24.686135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.session.flush() Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application compat.raise_( Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 20:00:24.687615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:00:24.688482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result.read() Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:00:24.689820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [parameters: {'id': '177272b9dd624329b31690d18801329b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:24.690595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 20:00:24.695474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:24.697494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 231/478] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 17 20:00:24 2022] POST /identity/v3/roles => generated 144 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:24.697635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00219f37-4523-40d3-83db-70513e076462 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:24.824972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00219f37-4523-40d3-83db-70513e076462 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:24.863540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c0c57-1f03-434a-a4ff-dedf587d41df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:24.864193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0c57-1f03-434a-a4ff-dedf587d41df None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:24.864471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0c57-1f03-434a-a4ff-dedf587d41df None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:24.864787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0c57-1f03-434a-a4ff-dedf587d41df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:24.876957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c0c57-1f03-434a-a4ff-dedf587d41df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f17c0c57-1f03-434a-a4ff-dedf587d41df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:24.883076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:24.885320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:24.886937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 248/479] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:24.894069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:24.933630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:25.151137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92f367-66a0-47c8-b882-87af922495b9 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:25.213811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701f361-39a9-4d98-ab5b-2e5a3816e3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:25.214917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f361-39a9-4d98-ab5b-2e5a3816e3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.215407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f361-39a9-4d98-ab5b-2e5a3816e3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.215913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f361-39a9-4d98-ab5b-2e5a3816e3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:25.217134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f361-39a9-4d98-ab5b-2e5a3816e3c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:25.217758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f361-39a9-4d98-ab5b-2e5a3816e3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:25.220509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f361-39a9-4d98-ab5b-2e5a3816e3c9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:25.237464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 232/480] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:25.475619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aba7b2-a10c-4815-8586-23fc3adfb9b7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.476294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aba7b2-a10c-4815-8586-23fc3adfb9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.476294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aba7b2-a10c-4815-8586-23fc3adfb9b7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:25.477693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 249/481] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:25.483386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27bfe-8092-4ab2-9e28-73c5be62c05a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.483687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27bfe-8092-4ab2-9e28-73c5be62c05a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.483928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27bfe-8092-4ab2-9e28-73c5be62c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:25.510964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-53b27bfe-8092-4ab2-9e28-73c5be62c05a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:25.512205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-53b27bfe-8092-4ab2-9e28-73c5be62c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:25.598754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 233/482] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:25.899530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aba7b2-a10c-4815-8586-23fc3adfb9b7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:25.956876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.018315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aba7b2-a10c-4815-8586-23fc3adfb9b7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.058825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.059555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.059833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.060107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.073639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:26.079241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:26.081576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:26.084230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 250/483] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:26.090661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27bfe-8092-4ab2-9e28-73c5be62c05a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.091147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.204705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27bfe-8092-4ab2-9e28-73c5be62c05a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.245645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6268-d448-4bcb-a549-573209b13244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.246083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6268-d448-4bcb-a549-573209b13244 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.246362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6268-d448-4bcb-a549-573209b13244 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.246654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6268-d448-4bcb-a549-573209b13244 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.247343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce6268-d448-4bcb-a549-573209b13244 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:26.247646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce6268-d448-4bcb-a549-573209b13244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.249169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce6268-d448-4bcb-a549-573209b13244 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.263737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 234/484] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:26.265198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.425440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035a847-cb54-41b8-b97a-bfa223cf5eee None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.434119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.464159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.464797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.465086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.465363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.482734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.484216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.498094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8591-b344-45d7-a1a6-2721307b3b12 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.498404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8591-b344-45d7-a1a6-2721307b3b12 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.498721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8591-b344-45d7-a1a6-2721307b3b12 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.500060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 235/485] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:26.507303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bce58-9836-4662-8017-7ba31c8a1f08 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.507813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bce58-9836-4662-8017-7ba31c8a1f08 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.508299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bce58-9836-4662-8017-7ba31c8a1f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:26.509621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:26.511686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:26.513627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:26.513627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:26.513627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:26.513627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 251/486] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:26.528637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.559022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a15bce58-9836-4662-8017-7ba31c8a1f08 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:26.560230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a15bce58-9836-4662-8017-7ba31c8a1f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:26.652051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862952-ee30-4a99-90ca-5720b1c6abcc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.666331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 236/487] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:26.667693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6c585-545f-43a9-ae22-a1535f180728 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.667979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6c585-545f-43a9-ae22-a1535f180728 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.668256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6c585-545f-43a9-ae22-a1535f180728 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.669874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 237/488] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:26.680610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b612b-6827-41e6-8383-c9bb40666430 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.680913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b612b-6827-41e6-8383-c9bb40666430 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.681158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b612b-6827-41e6-8383-c9bb40666430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.702955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.703291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.703654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.703941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.704274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.705069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:26.706672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.706877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.724010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-209b612b-6827-41e6-8383-c9bb40666430 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:26.724010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-209b612b-6827-41e6-8383-c9bb40666430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:26.734146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 252/489] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:26.738195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.776007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.882609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 238/490] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:26.921230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9d5f-bc52-4ece-9d5e-aed9ca458ed7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.958188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.958980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.959192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.959566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.967717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.969191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:26.984193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:26.985123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:26.986011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 253/491] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:26.991811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b612b-6827-41e6-8383-c9bb40666430 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.096461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.207707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b612b-6827-41e6-8383-c9bb40666430 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.252347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.263031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.275347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.275976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.276308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.276587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.277391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:27.277694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.278877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e8787-f605-4241-8489-816abd422241 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.279451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.322055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.322940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.323329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.323711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.332594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 239/492] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:27.333999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.343433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:27.352500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:27.353451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:27.354222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:27.354877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 254/493] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:27.355580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.465202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186693-78b9-4a0c-baf5-e749573cd305 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.506538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4a177-5b3b-4651-adcf-9d59d6f0a80d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.509313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.510294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.510576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.510874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.525370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:27.532123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:27.533090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:27.533877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 240/494] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:27.534957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.570515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.571899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.572533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.573135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.587766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.593898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.673101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881956e0-12f0-47b9-b6e0-372dfbbb73d0 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.719180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.720697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.721366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.722016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.723491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:27.724860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.726085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.726471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.728880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.745385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 241/495] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:27.747029 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.869345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 255/496] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:27.869345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.921379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.936033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2dda8-650c-4a53-b771-83ff03e7e773 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.940208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.985672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.987393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.988213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.989122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.990819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:27.991402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.993718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.011409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 242/497] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.011409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.025299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421df54-7e79-412f-ae8c-55d1ff3a811f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.079690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07511c-7a51-44fd-9b21-32ad1c96d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.080743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07511c-7a51-44fd-9b21-32ad1c96d428 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.081220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07511c-7a51-44fd-9b21-32ad1c96d428 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.081685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07511c-7a51-44fd-9b21-32ad1c96d428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.095480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07511c-7a51-44fd-9b21-32ad1c96d428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.096968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07511c-7a51-44fd-9b21-32ad1c96d428 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ee07511c-7a51-44fd-9b21-32ad1c96d428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:28.113463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:28.115860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:28.117763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:28.117763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:28.117763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:28.120523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 256/498] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:28.121928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1d7d-b1b0-4397-a9c7-3ddb06df842c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.122217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1d7d-b1b0-4397-a9c7-3ddb06df842c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.122497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1d7d-b1b0-4397-a9c7-3ddb06df842c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.123907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 257/499] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:28.124650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1d7d-b1b0-4397-a9c7-3ddb06df842c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.162590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1af4b-2d26-400b-a390-c0f4169e2668 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.211834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.213240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.213522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.213800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.229274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.231847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:28.253622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:28.254681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:28.256888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:28.256888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:28.256888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:28.258822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 243/500] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:28.260284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.265111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.278035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1d7d-b1b0-4397-a9c7-3ddb06df842c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.292153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.320564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d676006-c54a-4be8-8b28-38f941a353f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.321540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d676006-c54a-4be8-8b28-38f941a353f6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.321973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d676006-c54a-4be8-8b28-38f941a353f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.322407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d676006-c54a-4be8-8b28-38f941a353f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.342852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d676006-c54a-4be8-8b28-38f941a353f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.345372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d676006-c54a-4be8-8b28-38f941a353f6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9d676006-c54a-4be8-8b28-38f941a353f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:28.364240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:28.366254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:28.367121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:28.367121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:28.367121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:28.367121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 258/501] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:28.367503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9a94-ef91-497c-b6cc-e65ab7962b8d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.367781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9a94-ef91-497c-b6cc-e65ab7962b8d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.368038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9a94-ef91-497c-b6cc-e65ab7962b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.396020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-052d9a94-ef91-497c-b6cc-e65ab7962b8d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:28.397716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-052d9a94-ef91-497c-b6cc-e65ab7962b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:28.405691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4443b-f808-4244-aace-6698b876c15d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.443683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.444297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.444587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.444893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.445559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:28.445864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.447314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.459807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 244/502] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.460693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.495367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 259/503] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:28.496765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bde7a-1f7e-4f73-a409-623a26b871cc None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.497055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bde7a-1f7e-4f73-a409-623a26b871cc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.497337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bde7a-1f7e-4f73-a409-623a26b871cc None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.498926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 260/504] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:28.499518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bde7a-1f7e-4f73-a409-623a26b871cc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.572130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.590406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.601048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42c7d-e37e-4565-a3f3-1e96c6619d62 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.639092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bde7a-1f7e-4f73-a409-623a26b871cc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.642851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.643597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.643980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.644361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.645138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:28.645547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.647453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.677259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 245/505] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.678685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.700799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7e43c-0a4b-4986-8d43-a7127449206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.701688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e43c-0a4b-4986-8d43-a7127449206c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.701965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e43c-0a4b-4986-8d43-a7127449206c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.702237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e43c-0a4b-4986-8d43-a7127449206c None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.703095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7e43c-0a4b-4986-8d43-a7127449206c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:28.703716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7e43c-0a4b-4986-8d43-a7127449206c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.705124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7e43c-0a4b-4986-8d43-a7127449206c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.723094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 261/506] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.725112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8135-ecf8-4d07-bedc-2c1dcd2b8505 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.725621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8135-ecf8-4d07-bedc-2c1dcd2b8505 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.725922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8135-ecf8-4d07-bedc-2c1dcd2b8505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.756242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cc6a8135-ecf8-4d07-bedc-2c1dcd2b8505 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:28.757835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cc6a8135-ecf8-4d07-bedc-2c1dcd2b8505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:28.816490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e754413-4c1e-4b8b-b7e0-1cf865260767 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.843931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 262/507] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:28.844125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a8135-ecf8-4d07-bedc-2c1dcd2b8505 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.865635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.866977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.867261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.867538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.876915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.878377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.880448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:28.893431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:28.900922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 246/508] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:28.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.948884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.994122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a8135-ecf8-4d07-bedc-2c1dcd2b8505 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.034178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.034859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.035150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.035429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.042857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.044339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.062816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477fe1-e07b-4f65-bcf2-ea83b5524628 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:29.076205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:29.077688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 263/509] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:29.086531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.107479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.108136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.108588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.109614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.119307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.120783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:29.138993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:29.140049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:29.141079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:29.142968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 247/510] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:29.144021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.200287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43826c5-441a-4cf3-82ae-cb21efd126a5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.228163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.228875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.241813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.244775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.244775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.244775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.254620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:29.259839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:29.260879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:29.261645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 264/511] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:29.263158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.291000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f0a6b-5c33-41d1-a025-fe8fdbb0471d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.337664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.338657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.339128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.339574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.340752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:29.341591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.343710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.372441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 248/512] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.373352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.404462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a8334-8192-4c3a-90df-fa2654ebd4c0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.461899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.462337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.462618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.462926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.463652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:29.463957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.465447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.487702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 265/513] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.488577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.519707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c00c3a-5bc2-4e3b-9919-44d4bb16c248 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.547589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.549646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.579400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.580050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.580332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.580615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.594074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.595873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:29.619913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:29.621286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:29.622528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:29.622528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:29.622528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:29.622528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 249/514] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:29.623374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f5caa-63fd-4ce6-885d-8244c2fb2c31 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.623867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.673055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.674040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.674541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.675041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.676362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:29.676739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.680771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.741479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 266/515] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.743005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.753708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c295f9b-cea5-48ce-bb51-ccdc9674c3b0 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.806759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.807376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.807660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.807939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.808615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:29.808920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.810294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.824707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 250/516] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.824707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.867283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.867928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.871768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd36946-add8-429f-8e2b-565eaeb8f45e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.917605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.918245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.918526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.918845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.961698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53c706-613f-4ed2-8070-608ec7019809 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:30.001194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.002300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.002588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.003070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.003819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=6e3e10f9efeb4b908bf3d74ce1eb6a3a) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:30.004003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.004147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.005870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.006088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.012888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 251/517] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/role_assignments?user.id=6e3e10f9efeb4b908bf3d74ce1eb6a3a&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:30.013571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:30.149325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:30.154405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:30.157803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba005a2-2404-4885-9bd9-21eb64d83223 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:30.163971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 267/518] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:30.163971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:30.210361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.211042 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.211322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.211597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.212300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:30.212606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.213984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.237708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 252/519] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:30.237708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:30.296412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da72e88-2342-48b5-933d-fb47d501239d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:30.342900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.343637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.343988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.344341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.396288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa4941-920d-4f86-a894-06d1c3348c91 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:30.427645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:30.430026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.431538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.438922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.439116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.441028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.441028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.456320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.457869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:30.473094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:30.474249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:30.475248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:30.475248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:30.475248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:30.475248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 253/520] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:30.475823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:30.493197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:30.573241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 268/521] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:30.573241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:30.608948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebbb48-b0b4-42ed-9ef3-75f82dfd9b39 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:30.654606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.655850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.656130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.656518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.680070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.684185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:30.701950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:30.705427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:30.706276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:30.706276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:30.706276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:30.706276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 254/522] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:30.706276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:30.715799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:30.720547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f92be8-6a4b-41f9-b814-ec82185bc193 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:30.766777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.767567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.767953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.768299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.768945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.770399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.788507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:30.834840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad982847-cdd2-4e67-aa1e-0198bf9980dc None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:30.870947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 269/523] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:30 2022] POST /identity/v3/users => generated 247 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:30.872328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:30.885066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.886480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.887272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.888050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.889267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:30.890268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.892953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.918853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 255/524] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:30.920328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:31.091730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c07cd3-d93a-4f80-ac14-39b835768f40 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:31.129112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e04372-f523-4ecc-90d0-67f055a71ab5 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:31.162314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:31.166114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:31.167848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:31.167848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:31.168157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:31.189958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:31.194696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:31.200524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:31.201821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:31.202441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:31.203053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:31.204174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:31.204825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:31.206940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:31.219121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:31.220882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:31.222676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:31.222676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:31.222676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:31.222676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 270/525] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:31.224722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:31.235600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 256/526] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:31.237302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:31.247097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:31.429850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27c93-2a8d-477a-ab44-104360593d73 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:31.435033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede54-c814-4a6e-a955-4e447407b957 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:31.499261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:31.500298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:31.500787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:31.501270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:31.507101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:31.508590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:31.509356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:31.510124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:31.511620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:31.512473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:31.515393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:31.516926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:31.519834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:31.546928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:31.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:31.550488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:31.553279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 271/528] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:31.553279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:31.556041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 257/528] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:31.558037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:31.619925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:31.691770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:31.694119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4561c-f21e-46e9-8783-7e24d5abd8af None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:31.733697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:31.734824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:31.735922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:31.736357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:31.745312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:31.747036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:31.755360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216c06-8dbe-4891-9d28-1c53e5869cd6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:31.760993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:31.761926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:31.762865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:31.764505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 258/529] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:31.765471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:31.821774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:31.822845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:31.823350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:31.823862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:31.837138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:31.839757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:31.862504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:31.863424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:31.864233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:31.865661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 272/530] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:31.867456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:31.881949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:31.887038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd5bb-eb54-423e-a9b3-252d10917d1a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:31.928626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:31.929646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:31.930224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:31.930765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:31.931800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:31.932378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:31.934102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:31.955800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 259/531] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:31.957007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:32.070235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d8b6-8f3a-4def-b8b9-180a0b5af563 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:32.072519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed26b5-efc6-4268-80bc-662af9260199 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:32.112961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:32.113964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.114549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.115062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.116155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:32.116795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:32.118533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:32.121775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:32.135029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:32.136534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.136679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.137171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.138735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:32.139032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:32.141683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:32.142978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 260/532] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:32.144054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:32.166607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 273/533] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:32.167234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:32.168272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:32.265811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb357-b0f7-4262-8ed9-35c68919829b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:32.306768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbffd54-48ea-48a7-9900-80a96a425891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:32.307869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbffd54-48ea-48a7-9900-80a96a425891 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.308351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbffd54-48ea-48a7-9900-80a96a425891 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.308830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbffd54-48ea-48a7-9900-80a96a425891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.351256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f0f4-5298-4cb9-b093-f3c765482f0a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:32.391509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbffd54-48ea-48a7-9900-80a96a425891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:32.393358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbffd54-48ea-48a7-9900-80a96a425891 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:32.413827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:32.415537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:32.416593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.417088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.417558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.418903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=765ee8241c4e448eb999016b17132e37) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:32.419461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:32.422500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:32.433230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 274/534] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:32 2022] GET /identity/v3/role_assignments?user.id=765ee8241c4e448eb999016b17132e37&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:32.434982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:32.535797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 261/535] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:32.538911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d729b-e134-45c0-9096-53d15c93d91e None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.539779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d729b-e134-45c0-9096-53d15c93d91e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.540540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d729b-e134-45c0-9096-53d15c93d91e None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.544574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 262/536] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:32.548598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d729b-e134-45c0-9096-53d15c93d91e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:32.556986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:32.638933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5623-f880-4098-bc84-a619d2144f76 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:32.684582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fec92-7f95-4805-9e00-154705d9169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:32.685572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fec92-7f95-4805-9e00-154705d9169c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.686039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fec92-7f95-4805-9e00-154705d9169c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.686469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fec92-7f95-4805-9e00-154705d9169c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.687400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fec92-7f95-4805-9e00-154705d9169c None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=a78694291dba47f1b833c721cb728460) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:32.687865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fec92-7f95-4805-9e00-154705d9169c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:32.691095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fec92-7f95-4805-9e00-154705d9169c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:32.698972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 275/537] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:32 2022] GET /identity/v3/role_assignments?user.id=a78694291dba47f1b833c721cb728460&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:32.700491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbcf6e-bb6a-4606-8cfa-5aa1742d129e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.700926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbcf6e-bb6a-4606-8cfa-5aa1742d129e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.701350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbcf6e-bb6a-4606-8cfa-5aa1742d129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.724287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e3dbcf6e-bb6a-4606-8cfa-5aa1742d129e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:32.726130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e3dbcf6e-bb6a-4606-8cfa-5aa1742d129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:32.764032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d729b-e134-45c0-9096-53d15c93d91e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:32.813581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 276/538] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:32.827155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:32.866080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:32.867154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.867608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.868059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.897048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:32.899589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:32.929379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:32.930332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:32.931221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:32.931221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:32.931221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:32.937864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 263/539] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:32.943486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbcf6e-bb6a-4606-8cfa-5aa1742d129e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.031810 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:33.133102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbcf6e-bb6a-4606-8cfa-5aa1742d129e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:33.205359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:33.206476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.206984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.207490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.208828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:33.209408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:33.212069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:33.242868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 277/540] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:33.246830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.417841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.455388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea2f6b-7d32-43ea-bfa7-46a9cce74f54 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:33.534971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:33.537486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.538049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.538474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.552667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:33.558655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:33.582382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:33.583890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:33.584706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:33.585549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 264/541] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:33.594085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.663390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:33.677574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389a3b3-274e-4147-b622-b44e51eac275 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:33.691801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:33.750400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:33.751098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.751384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.751663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.777239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:33.782946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:33.784861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:33.787616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:33.797420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 278/542] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:33.798386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.825177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe71df-8739-4bbd-9438-53c3a275d185 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:33.925780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:33.926403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.926718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.928120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.928338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:33.928748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:33.930223 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:33.958362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 265/543] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:33.965020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.985972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c9699-bc4b-43cd-b412-e838f1062f17 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.071671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.072366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.072660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.072935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.073626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:34.073931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.075356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.103010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 279/544] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:34.116736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.129889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:34.138547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38e18-732c-4b4b-9ed0-bfd067bc2ce6 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.180615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.181144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.181430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.181712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.182469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=0ac7372634fa47df8d7fb36c98f7e0ad) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:34.182855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.184623 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.191809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 266/545] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/role_assignments?user.id=0ac7372634fa47df8d7fb36c98f7e0ad&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:34.217470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:34.391384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91273a0-12cd-462c-a2af-22b80dab1b38 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.484330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8c57a-6d1a-4c14-8325-cf5da0ef1a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.485298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c57a-6d1a-4c14-8325-cf5da0ef1a2f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.485867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c57a-6d1a-4c14-8325-cf5da0ef1a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.486359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c57a-6d1a-4c14-8325-cf5da0ef1a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.510569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8c57a-6d1a-4c14-8325-cf5da0ef1a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.513384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8c57a-6d1a-4c14-8325-cf5da0ef1a2f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-87d8c57a-6d1a-4c14-8325-cf5da0ef1a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:34.561140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:34.562940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:34.565315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:34.565315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:34.565315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:34.565315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 280/546] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:34.579807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.634084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3fe28-83fb-48cb-96f4-b408efffe2d5 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.634576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3fe28-83fb-48cb-96f4-b408efffe2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.635136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3fe28-83fb-48cb-96f4-b408efffe2d5 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.642839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 281/547] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:34.648244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5723-917c-4bd7-ad03-0ba0e062ba90 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.648797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5723-917c-4bd7-ad03-0ba0e062ba90 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.649248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5723-917c-4bd7-ad03-0ba0e062ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.690660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6fca5723-917c-4bd7-ad03-0ba0e062ba90 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:34.690660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6fca5723-917c-4bd7-ad03-0ba0e062ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:34.703279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cefc60-b911-454d-a0b4-ddcf4dd4dfce None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.746437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.747022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.747311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.747591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.748285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:34.748594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.750059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.782471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 267/548] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:34.792960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.820812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:34.851266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 282/549] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:34.981130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73066013-0669-477c-bcfd-4604e17051a6 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.023388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.023953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.024247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.024528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] PATH_INFO: `/v3/users/glance` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.033304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.034847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:35.056936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:35.058583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:35.060578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 268/550] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:35.068047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5723-917c-4bd7-ad03-0ba0e062ba90 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.088285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.237617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5723-917c-4bd7-ad03-0ba0e062ba90 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.321477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.322366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.322892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.323362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.324710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:35.325245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.328274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.372204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 283/551] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:35.377475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.437771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.511883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.540365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77b89c-d973-436e-9bf6-5b3f8a663ddf None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.584017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.585720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.585720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.585720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.598320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.600426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.604944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:35.621205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:35.630814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:35.631762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:35.631762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:35.631762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:35.631762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 269/552] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:35.633224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.719115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba6872-1ddb-4e3a-a88e-6f78986df551 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.797291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c3da-5c87-4d5e-8d58-3a9bcf0901ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.798940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c3da-5c87-4d5e-8d58-3a9bcf0901ce None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.799710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c3da-5c87-4d5e-8d58-3a9bcf0901ce None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.800493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c3da-5c87-4d5e-8d58-3a9bcf0901ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.814608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd4c3a-edb7-40b7-ad30-f31f780bf413 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.825136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425c3da-5c87-4d5e-8d58-3a9bcf0901ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a425c3da-5c87-4d5e-8d58-3a9bcf0901ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:35.837466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:35.839211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:35.840778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:35.844462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.854655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 284/553] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:35.869196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf22ed6-b96d-444b-beca-eb72ecf86c69 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.869196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf22ed6-b96d-444b-beca-eb72ecf86c69 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.869485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6331564-818f-4aac-9090-e44e3358fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.869637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf22ed6-b96d-444b-beca-eb72ecf86c69 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.869782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6331564-818f-4aac-9090-e44e3358fde0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.869782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6331564-818f-4aac-9090-e44e3358fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.869782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6331564-818f-4aac-9090-e44e3358fde0 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.869782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6331564-818f-4aac-9090-e44e3358fde0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:35.869782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6331564-818f-4aac-9090-e44e3358fde0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.870343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 285/554] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:35.870480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6331564-818f-4aac-9090-e44e3358fde0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.870621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf22ed6-b96d-444b-beca-eb72ecf86c69 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.877500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 270/555] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:35.879117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cce61-95fc-4eea-9fef-930c2efeb73b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.879409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cce61-95fc-4eea-9fef-930c2efeb73b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.879751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cce61-95fc-4eea-9fef-930c2efeb73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.903257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6e7cce61-95fc-4eea-9fef-930c2efeb73b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:35.904804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6e7cce61-95fc-4eea-9fef-930c2efeb73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:35.996783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 271/556] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:35.997831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cce61-95fc-4eea-9fef-930c2efeb73b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.070329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf22ed6-b96d-444b-beca-eb72ecf86c69 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.110696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:36.122824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f212-9111-4137-8442-1091a3f13503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.127714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f212-9111-4137-8442-1091a3f13503 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.127714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f212-9111-4137-8442-1091a3f13503 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.127714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f212-9111-4137-8442-1091a3f13503 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.127714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f212-9111-4137-8442-1091a3f13503 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:36.127714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f212-9111-4137-8442-1091a3f13503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:36.127714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f212-9111-4137-8442-1091a3f13503 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:36.141342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 286/557] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:36.143679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335b88-301d-42fe-b71b-046c954782af None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.144302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335b88-301d-42fe-b71b-046c954782af None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.145390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335b88-301d-42fe-b71b-046c954782af None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.147965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 287/558] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:36.149069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335b88-301d-42fe-b71b-046c954782af None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.228165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cce61-95fc-4eea-9fef-930c2efeb73b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.246966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:36.271873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b322ac3-b22f-4d3a-ac9e-8ce4f2f2ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.272563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b322ac3-b22f-4d3a-ac9e-8ce4f2f2ea88 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.272941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b322ac3-b22f-4d3a-ac9e-8ce4f2f2ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.273224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b322ac3-b22f-4d3a-ac9e-8ce4f2f2ea88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.282809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b322ac3-b22f-4d3a-ac9e-8ce4f2f2ea88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:36.284767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b322ac3-b22f-4d3a-ac9e-8ce4f2f2ea88 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-3b322ac3-b22f-4d3a-ac9e-8ce4f2f2ea88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:36.298857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:36.301475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:36.303914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:36.307096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 272/559] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:36.308631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3094a-91bf-47f5-b098-7f9c6fbd6f56 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.309024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3094a-91bf-47f5-b098-7f9c6fbd6f56 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.309408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3094a-91bf-47f5-b098-7f9c6fbd6f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.363988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335b88-301d-42fe-b71b-046c954782af None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.383206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d4f3094a-91bf-47f5-b098-7f9c6fbd6f56 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:36.385335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d4f3094a-91bf-47f5-b098-7f9c6fbd6f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:36.431906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.433240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.433736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.435294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.457794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:36.461333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:36.476693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 273/560] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:36.478802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3094a-91bf-47f5-b098-7f9c6fbd6f56 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:36.491659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:36.492907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:36.493751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:36.493751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:36.493751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:36.494438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 288/561] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:36.500754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.581602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:36.648082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998cc2d-9e44-4552-8cf5-6709bb6ba0e8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.655650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3094a-91bf-47f5-b098-7f9c6fbd6f56 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.675048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:36.697892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.698806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.699230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.699680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.700472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:36.700915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:36.702432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:36.720954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 289/562] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:36.720954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.735079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.736305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.736825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.737415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.738751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:36.739939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:36.743344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:36.775825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 274/563] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:36.778136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.909229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ac5df-7a6c-41d8-a6b1-6bcce0c1335a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.913621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:36.925447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b91c4b-7cf6-4da5-a033-7d8d0fbe198d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.962670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.963728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.964313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.964782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.980394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:36.985554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:36.986488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:36.987315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:36.990851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 290/564] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:36.992070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.009596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.010963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.011491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.012580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.027440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:37.030328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:37.052536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:37.053911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 275/565] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:37.060028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.102178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:37.127399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9394f3-68d5-477c-84fc-3e3b357cec47 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.176306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548b8f2-2a55-4f2a-be63-c8b254faa8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.177779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548b8f2-2a55-4f2a-be63-c8b254faa8ce None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.178271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548b8f2-2a55-4f2a-be63-c8b254faa8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.178783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548b8f2-2a55-4f2a-be63-c8b254faa8ce None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/6e3e10f9efeb4b908bf3d74ce1eb6a3a/roles/6666a44189e7493d9de289fe534d6dff` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.197525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd52b86-110f-4ac3-9c6a-fcf3fd2dc0eb None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.204105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548b8f2-2a55-4f2a-be63-c8b254faa8ce None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=6e3e10f9efeb4b908bf3d74ce1eb6a3a, role_id=6666a44189e7493d9de289fe534d6dff)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:37.206712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548b8f2-2a55-4f2a-be63-c8b254faa8ce None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:37.232425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.233082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.233417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.233738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.234447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:37.234834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:37.236298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:37.246399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 276/566] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:37.247781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.288501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 291/567] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:36 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/6e3e10f9efeb4b908bf3d74ce1eb6a3a/roles/6666a44189e7493d9de289fe534d6dff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:37.291183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e643d-c8e5-41d8-a243-c101e55adf5e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.291628 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e643d-c8e5-41d8-a243-c101e55adf5e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.292060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e643d-c8e5-41d8-a243-c101e55adf5e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.294266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 292/568] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:37.295609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e643d-c8e5-41d8-a243-c101e55adf5e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.319509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:37.402527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:37.429753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d029bf-142f-4a83-a9b6-af24b62b0e86 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.454844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e643d-c8e5-41d8-a243-c101e55adf5e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.499031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1292-d26d-4416-b688-296246d9148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.499984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1292-d26d-4416-b688-296246d9148a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.500272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1292-d26d-4416-b688-296246d9148a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.500545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1292-d26d-4416-b688-296246d9148a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.515669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1292-d26d-4416-b688-296246d9148a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:37.516101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bac5d-08de-4fbb-bdcf-247be815ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.517052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bac5d-08de-4fbb-bdcf-247be815ea9b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.517536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bac5d-08de-4fbb-bdcf-247be815ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.518016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bac5d-08de-4fbb-bdcf-247be815ea9b None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.519482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bac5d-08de-4fbb-bdcf-247be815ea9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:37.520022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bac5d-08de-4fbb-bdcf-247be815ea9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-661a1292-d26d-4416-b688-296246d9148a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:37.522714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:37.524455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:37.528143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:37.531289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bac5d-08de-4fbb-bdcf-247be815ea9b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:37.531524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 277/569] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:37.531524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1292-d26d-4416-b688-296246d9148a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.561528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 293/570] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:37.568623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1be8dd-baec-4327-b3d9-ab47a05e7ec7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.570026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1be8dd-baec-4327-b3d9-ab47a05e7ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.571041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1be8dd-baec-4327-b3d9-ab47a05e7ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.611197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6d1be8dd-baec-4327-b3d9-ab47a05e7ec7 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:37.613064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6d1be8dd-baec-4327-b3d9-ab47a05e7ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:37.690821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1292-d26d-4416-b688-296246d9148a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.726291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:37.742676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 294/571] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:37.742676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1be8dd-baec-4327-b3d9-ab47a05e7ec7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.774475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.776457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.777079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.777700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.803500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:37.808050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:37.821993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:37.838070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:37.839979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:37.842566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:37.842566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:37.842566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:37.842566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 278/572] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:37.842566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.956103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1be8dd-baec-4327-b3d9-ab47a05e7ec7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.995009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.995648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.995913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.996152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.996830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:38.002663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.002663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.008533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 295/573] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:38.009401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.064567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca81901-0bd1-4f2a-9e42-132ba9cfd6a9 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.132843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.133879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.134373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.134900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.139067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.143212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eac750-fe76-475b-90c6-20ae452d04f9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.182476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.183156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.183443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.183721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.184375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:38.184735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.186177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.200284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 296/574] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:38.201352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.267747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.277630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.284388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.332013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e7b2-d045-42a7-887c-af992990b1e4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.363884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.378991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.380434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.381535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.381944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.394213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.397021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:38.414586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:38.415741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:38.416794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:38.416794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:38.416794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:38.420484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 297/575] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:38.421431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.462663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 279/576] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:38.462663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.568103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997797f-045d-48de-ab83-5402f47c70a1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.611151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.611956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.612423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.612884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.623151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.624634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.637463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.641979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e827db-6dc6-499b-a3f1-31f040b77a0d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:38.645988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:38.657919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 298/577] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:38.659904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.710821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.716741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.717930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.718345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.718852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.739554 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:38.749179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:38.750749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:38.751944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 280/578] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:38.753261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.812812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae5fe8-e1c0-4fb9-89f9-4ca39a53c896 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.871115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.871926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.872331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.872742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.873685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:38.874122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.875814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.890787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 299/579] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:38.892084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.948685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0adf0-0c8e-488e-8708-763b0a57eba7 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.995041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.995867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.996282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.996916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.012171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.013662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:39.031547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.032844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:39.034124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:39.034124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:39.034124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:39.034124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 281/580] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.034124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.049509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.061106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.073168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eb1b0-7195-40ed-b12e-7c41b80f7f83 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.117495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.118125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.118410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.118774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.120148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:39.120459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.122313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.154030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 300/581] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:39.154030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.201211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fd705-17e4-4763-a70e-994d4509758e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.269213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.270276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.270911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.271402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.272667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:39.273131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.275825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.291550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 282/582] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:39.293158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.313711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da2247-783b-46e8-8709-ede3687f16bd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.376852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.377400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.377685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.377963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.394204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.394726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.396307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:39.413875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.416226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 301/583] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.418592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.438164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0a35b-1883-4f2e-bb86-590fcec642c0 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.440190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.483894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.484730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.485248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.485831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.487109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:39.487669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.490789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.507788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 283/584] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:39.508626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.548439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cee33-3eba-4f19-90ef-08fa676c4eb4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.598854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec73ef-2f3f-43f3-b127-4777d8a91289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.599591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec73ef-2f3f-43f3-b127-4777d8a91289 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.599885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec73ef-2f3f-43f3-b127-4777d8a91289 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.600161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec73ef-2f3f-43f3-b127-4777d8a91289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.614937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec73ef-2f3f-43f3-b127-4777d8a91289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.617547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec73ef-2f3f-43f3-b127-4777d8a91289 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.628969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2ae9e-08a7-462a-b93c-043bbe060648 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2eec73ef-2f3f-43f3-b127-4777d8a91289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:39.645110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.646922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:39.647967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:39.647967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:39.647967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:39.647967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 302/585] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.650065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a4c4-0bed-4bfa-9359-ceb7b9b95f89 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.650581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a4c4-0bed-4bfa-9359-ceb7b9b95f89 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.651107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a4c4-0bed-4bfa-9359-ceb7b9b95f89 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.653664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 303/586] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:39.655293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a4c4-0bed-4bfa-9359-ceb7b9b95f89 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.666285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.671462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.672179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.672471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.679317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.687285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.690087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:39.719421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.721020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:39.721895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:39.721895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:39.721895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:39.721895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 284/587] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.722857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.749713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.793204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a4c4-0bed-4bfa-9359-ceb7b9b95f89 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.832239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.833297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.833808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.834302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.835752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:39.836323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.839080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.851448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b5b2-f958-4fc8-86f4-e0b403fd66f6 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.871884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 304/588] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:39.873164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.891941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a4a06-cdb6-4ede-a0c9-8e13070ad231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.892519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a4a06-cdb6-4ede-a0c9-8e13070ad231 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.892776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a4a06-cdb6-4ede-a0c9-8e13070ad231 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.894117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a4a06-cdb6-4ede-a0c9-8e13070ad231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.900727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a4a06-cdb6-4ede-a0c9-8e13070ad231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.902210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a4a06-cdb6-4ede-a0c9-8e13070ad231 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-e65a4a06-cdb6-4ede-a0c9-8e13070ad231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:39.915145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.916181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:39.917358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 285/589] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.917984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a328b6-8da0-4bed-8e75-a35c5b931bc8 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.918056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a328b6-8da0-4bed-8e75-a35c5b931bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.918360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a328b6-8da0-4bed-8e75-a35c5b931bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.937547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-36a328b6-8da0-4bed-8e75-a35c5b931bc8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:39.938811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-36a328b6-8da0-4bed-8e75-a35c5b931bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:39.990574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.992577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7daa8-f4d5-44de-a5bf-ab03fedfacd8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.017893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 286/590] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:40.018784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a328b6-8da0-4bed-8e75-a35c5b931bc8 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.021963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.036813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.037668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.037953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.038229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.038911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.039213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.040594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.063759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 305/591] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.064630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.159283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a328b6-8da0-4bed-8e75-a35c5b931bc8 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.206129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.206781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.207061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.207325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.208388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c24cc-f5ad-44c9-b80f-1a7c5d444ddd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.208977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.208977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.210435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.230711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 287/592] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.230711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.276484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.277139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.277431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.277750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.294323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.295850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.297982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:40.315080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.316364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:40.318455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:40.318455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.318455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:40.321641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 306/593] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.322686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.370725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.394619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3abed-631e-413a-8681-a78a66b1ef8e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.435522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.436383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.436692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.437100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.438113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.438574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.440613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.456979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2152c2a-4639-44f6-a4cb-69f0f2defddd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.457834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 288/594] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.461005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.502224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.503066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.503353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.503636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.516033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.518544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:40.540372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.541330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:40.542176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:40.542596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 307/595] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.543733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.590552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.598120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efb5fb-9c4c-482d-ae93-4760a551e70d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.646305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.647381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.647730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.648078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.656276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.657720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:40.670649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.671951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 289/596] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.672871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.681611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.688874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e9720-f2b5-43b4-b2bc-b618ab57ced9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.728733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.729399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.729823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.730099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.741311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:40.746722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.747817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:40.748615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 308/597] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.749289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.822867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546b46-4e9b-48bb-9c38-2c73f5eee4ee None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.866342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.867143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.867579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.867998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.868910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.869301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.870865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.872230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e9c63-3c66-492c-8cd1-f297d0704223 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.884327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 290/598] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.885185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.902488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.924008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.924663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.924952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.925233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.925965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=fc0c376af51e4b5195da5ff453026ec9) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.926277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.927865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.934314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 309/599] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/role_assignments?user.id=fc0c376af51e4b5195da5ff453026ec9&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.935193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.960652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.039076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4314-2d44-4a1b-a4e6-1d34299b6f2d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.085653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.086116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac271b6-0c52-41c3-9d2d-954b49482010 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.086291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.086570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.086882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.088826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.088826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.090580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.106646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 291/600] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.107605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.148502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.149858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.150509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.151164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.152821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.153560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.156591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.196924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 310/601] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.196924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.237247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.271447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922554c-9526-4877-89d0-544d07e51522 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.315427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.326236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.327429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.327933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.328287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.329506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.330053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.332920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.343149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5ad29-1d8d-4f2c-abd7-4ca45cec41ee None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.348970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 292/602] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.350745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.390415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.391263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.391647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.392024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.400817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.402489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:41.423722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:41.424665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:41.425526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:41.425958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 311/603] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:41.427222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.493431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c12f1-e7c5-4aa3-b8a1-05bd86b780b2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.550007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.550690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.550970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.551246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/a78694291dba47f1b833c721cb728460/roles/6666a44189e7493d9de289fe534d6dff` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.555249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.562705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96419e97-d008-4583-9f14-1f79e029a43e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.580630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=a78694291dba47f1b833c721cb728460, role_id=6666a44189e7493d9de289fe534d6dff)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.582099 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.606034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.606693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.606982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.607248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.610295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.619455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.621028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:41.637938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:41.639118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:41.640098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:41.640098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:41.640098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:41.640566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 312/604] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:41.641422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.683005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 293/605] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:41 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/a78694291dba47f1b833c721cb728460/roles/6666a44189e7493d9de289fe534d6dff => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:41.695706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.798060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a09f-2e0d-4202-a37a-e3a838bdfcb9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.857554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.858561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.859137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.859635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.874558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.876619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.888264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959222-9c38-4172-989c-18b7a6896a3d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:41.896719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:41.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:41.898543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:41.898543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:41.898543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:41.898543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 313/606] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:41.899884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.935515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.937318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.937620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.937902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.938747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.939088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.941010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.962074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 294/607] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.963108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.967293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.022864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.057816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f2d82-e752-444b-bbaa-43eaa2b3e668 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.103917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.105035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.105513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.106291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.107268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:42.107783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.109348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.125647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 314/608] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:42.126839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.141041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df54a7-d6fd-41df-93e6-13e9613144f6 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.202546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.203814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.204310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.205165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.206172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:42.206719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.208896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.226766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 295/609] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:42.228386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.293003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.298956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337192a7-c3c7-4fe5-8847-2bc0435fa4b3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.363563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb9427-132a-4180-b0aa-9fe2a18efa99 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.365327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.367710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.368705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.369414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/765ee8241c4e448eb999016b17132e37/roles/6666a44189e7493d9de289fe534d6dff` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.373481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.402338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=765ee8241c4e448eb999016b17132e37, role_id=6666a44189e7493d9de289fe534d6dff)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.407990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.408268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.408893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.409871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.410253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.420058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.421684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:42.435362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:42.436954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:42.438727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:42.441730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 296/610] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:42.443050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.530882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 315/611] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:42 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/765ee8241c4e448eb999016b17132e37/roles/6666a44189e7493d9de289fe534d6dff => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:42.537066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.651908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe425-34d2-4177-ac05-cb784bd8ff9e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.730909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.732171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.732666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.733152 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.752551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.752551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:42.781622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:42.783445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:42.785239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 297/612] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:42.791017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.906579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.929690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ca6e-d9f3-4a3c-bd0f-54c737854c57 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.007323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a043d0-ac28-4ebd-83b0-44b1bc613b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.008354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a043d0-ac28-4ebd-83b0-44b1bc613b4e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.008836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a043d0-ac28-4ebd-83b0-44b1bc613b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.009315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a043d0-ac28-4ebd-83b0-44b1bc613b4e None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.010679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a043d0-ac28-4ebd-83b0-44b1bc613b4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:43.011276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a043d0-ac28-4ebd-83b0-44b1bc613b4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.014008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a043d0-ac28-4ebd-83b0-44b1bc613b4e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.042683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 316/613] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:43.042683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4f30b-0e07-47fa-8e14-17443f31484f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.042683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4f30b-0e07-47fa-8e14-17443f31484f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.042683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4f30b-0e07-47fa-8e14-17443f31484f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.044667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 317/614] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:43.052915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c85f5-996e-4d14-82a2-4e0ebf433a09 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.053397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c85f5-996e-4d14-82a2-4e0ebf433a09 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.053553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c85f5-996e-4d14-82a2-4e0ebf433a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.079938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1b1c85f5-996e-4d14-82a2-4e0ebf433a09 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:43.082281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054f11-559e-452d-9a4e-612c3a83515c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.082946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1b1c85f5-996e-4d14-82a2-4e0ebf433a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:43.089035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.123819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.124445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.124731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.125032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.125841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:43.126094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.127600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.148871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 298/615] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:43.149803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.235898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 318/616] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:43.237900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c85f5-996e-4d14-82a2-4e0ebf433a09 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.292900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.330848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03550-dfe9-4dfe-8281-425e6fbe0b4b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.428425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.429112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.429397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.429679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/0ac7372634fa47df8d7fb36c98f7e0ad/roles/6666a44189e7493d9de289fe534d6dff` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.440734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c85f5-996e-4d14-82a2-4e0ebf433a09 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.471717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=0ac7372634fa47df8d7fb36c98f7e0ad, role_id=6666a44189e7493d9de289fe534d6dff)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.475220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.513157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.514121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.514648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.515149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.541692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.614548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 299/617] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:43 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/0ac7372634fa47df8d7fb36c98f7e0ad/roles/6666a44189e7493d9de289fe534d6dff => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:43.621421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.648422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.649918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.784153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 319/618] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:43.784397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.836995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.909833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55220-4568-4b06-bce3-4f87c22bb89a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.950457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.951158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.951443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.952342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.965407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.967267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.978986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2f2e-4085-496c-acbe-9b393141fc02 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:43.985780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:43.988007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:43.990742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:43.990742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.990742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:43.990742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 320/619] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:43.999053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.049473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.050432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.050982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.052340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.057129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.073552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:44.085257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:44.088530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:44.091035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 300/620] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 472 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:44.096390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.175270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.196860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5245198-beed-4852-a810-de922ff88b7d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.275989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.276988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.277475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.277986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.279183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.279800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.281431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.300479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 321/621] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.308927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.312010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80fc6f-d136-471b-886f-6e073979ab62 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.354082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.354903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.355194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.355473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.356180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.356488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.358173 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.369434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 301/622] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.378329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.471070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.509718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3260831-a73e-40c5-8b1e-a7e71345a13e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.555323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.555916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.556205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.556490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.570678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.572516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:44.591255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:44.592382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:44.593346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:44.593346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:44.593346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:44.593517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 302/623] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:44.602327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.647363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a24b70-c897-4561-9586-c9687153f38b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.704274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aea39a-ff02-4a4d-b908-c2c588184648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.705479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea39a-ff02-4a4d-b908-c2c588184648 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.706003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea39a-ff02-4a4d-b908-c2c588184648 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.706549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea39a-ff02-4a4d-b908-c2c588184648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.717837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aea39a-ff02-4a4d-b908-c2c588184648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.719826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aea39a-ff02-4a4d-b908-c2c588184648 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.725853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f066f-ca6b-4846-b6ed-197c45673c3a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a6aea39a-ff02-4a4d-b908-c2c588184648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:44.734971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:44.735949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:44.736824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:44.738085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.741146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 322/624] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:44.742933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ac38-7bc7-46d3-a3b8-8ef58f6eec8f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.743542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ac38-7bc7-46d3-a3b8-8ef58f6eec8f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.744033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ac38-7bc7-46d3-a3b8-8ef58f6eec8f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.745645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 323/625] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:44.751090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5ac38-7bc7-46d3-a3b8-8ef58f6eec8f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.766444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2d48-f559-4855-b51f-08e17f9c4bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.767090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2d48-f559-4855-b51f-08e17f9c4bda None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.767375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2d48-f559-4855-b51f-08e17f9c4bda None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.767646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2d48-f559-4855-b51f-08e17f9c4bda None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.768319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2d48-f559-4855-b51f-08e17f9c4bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.768627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2d48-f559-4855-b51f-08e17f9c4bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.770040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2d48-f559-4855-b51f-08e17f9c4bda None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.770877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.787058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 303/626] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:44.788687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828e59-907d-460a-bc31-971d988b2ceb None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.788979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828e59-907d-460a-bc31-971d988b2ceb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.789257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828e59-907d-460a-bc31-971d988b2ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.812165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-cc828e59-907d-460a-bc31-971d988b2ceb None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:44.812592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-cc828e59-907d-460a-bc31-971d988b2ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:44.903020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 304/627] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:44.904177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5ac38-7bc7-46d3-a3b8-8ef58f6eec8f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.904965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc828e59-907d-460a-bc31-971d988b2ceb None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.966095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.968165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.969605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.970210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.971362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.972652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.976562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:45.004943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 324/628] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:45.012520 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:45.124767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:45.132579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc828e59-907d-460a-bc31-971d988b2ceb None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:45.157693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:45.209095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:45.209754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.210114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.210408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.220591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275cfc4-6f2b-4fa6-a17d-ecd1e05823e3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:45.224061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:45.225662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:45.248234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:45.249489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:45.250709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:45.252776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 305/629] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:45.253860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:45.269185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:45.270513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.270513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.270909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.271607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=6e3e10f9efeb4b908bf3d74ce1eb6a3a) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:45.271921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:45.273511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:45.281137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 325/630] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:45 2022] GET /identity/v3/role_assignments?user.id=6e3e10f9efeb4b908bf3d74ce1eb6a3a&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:45.282013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:45.402319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb09ee5-f4eb-464e-9fdb-dea51b0a4a65 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:45.414700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fcad0-20e8-44f0-a84e-d4c25db7e164 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:45.455928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:45.457000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.457494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.458012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.459110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:45.459638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:45.461550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:45.465192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:45.490649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:45.491655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.492095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.492526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.495273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 326/631] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 17 20:00:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:45.505518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:45.534093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:45.541437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:45.543202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:45.544764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:45.550894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 306/632] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:45.558126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:45.619974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:45.697220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34573c-d2d3-4852-8047-436b7ab4a889 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:45.756060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4296f-616c-496b-b7a4-e28064db8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:45.757204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4296f-616c-496b-b7a4-e28064db8c0e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.757767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4296f-616c-496b-b7a4-e28064db8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.758345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4296f-616c-496b-b7a4-e28064db8c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.779301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4296f-616c-496b-b7a4-e28064db8c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:45.780767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4296f-616c-496b-b7a4-e28064db8c0e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:45.795832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8aca0-34d0-43df-a785-68b1e8b68a60 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6cd4296f-616c-496b-b7a4-e28064db8c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:45.805947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:45.807905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:45.810750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:45.810750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:45.810750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:45.810750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 327/633] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:45.810750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc3c5f-53d9-4862-8650-80c59dd74f44 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.815572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc3c5f-53d9-4862-8650-80c59dd74f44 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.817793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc3c5f-53d9-4862-8650-80c59dd74f44 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.821923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 328/634] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:45.823585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc3c5f-53d9-4862-8650-80c59dd74f44 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:45.854395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc746801-77bd-4c18-9113-90dc16ffc938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:45.855229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746801-77bd-4c18-9113-90dc16ffc938 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.856177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746801-77bd-4c18-9113-90dc16ffc938 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.856642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746801-77bd-4c18-9113-90dc16ffc938 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.857642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc746801-77bd-4c18-9113-90dc16ffc938 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:45.858101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc746801-77bd-4c18-9113-90dc16ffc938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:45.860060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc746801-77bd-4c18-9113-90dc16ffc938 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:45.877802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 307/635] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:45.878277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7fa2-d17d-44dc-957c-fcff9d6d5076 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.878542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7fa2-d17d-44dc-957c-fcff9d6d5076 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.880295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7fa2-d17d-44dc-957c-fcff9d6d5076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.897761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:45.898418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-04ab7fa2-d17d-44dc-957c-fcff9d6d5076 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:45.900047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-04ab7fa2-d17d-44dc-957c-fcff9d6d5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:45.995191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc3c5f-53d9-4862-8650-80c59dd74f44 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.017438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 308/636] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:46.018986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7fa2-d17d-44dc-957c-fcff9d6d5076 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.041706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.058082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.059614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.060379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.061116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.062474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:46.063286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.065942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.094778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 329/637] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:46.098143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.219049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7fa2-d17d-44dc-957c-fcff9d6d5076 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.281191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e36c2-f2e0-413f-8a39-a3d15fb96b6d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.294277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.295752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.296263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.296857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.298196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.320129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.323541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.352838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.353840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.354315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.354842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:46.357615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:46.359418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:46.361141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:46.361141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:46.361141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:46.364894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 309/638] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:46.373922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.376620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.380725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:46.399276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:46.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:46.402743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:46.406852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 330/639] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:46.414199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.474316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.518249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c4d8-ae4b-4e6e-a07f-2136e80ccb4e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.556367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.557281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.557748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.558222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.559085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:46.559579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.561141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.575815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 310/640] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:46.577006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.598174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e96a8e-fdb3-4a7a-a6a9-68c1b49c0c40 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.664189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.665225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.665722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.666214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.667557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:46.668109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.670915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.697493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0cb46-8c64-468b-a5d8-f0bf367458ce None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.702226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 331/641] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:46.704017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.726088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.739820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.740794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.742001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.742001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.753669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:46.759124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:46.760486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:46.761448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:46.762109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.769331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 311/642] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:46.770822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.884098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f43a6f-5968-4332-9ff8-b55c0fc2dd24 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.905921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b93da7-c102-4674-a391-cb7506f65528 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.940466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.941768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.942331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.943035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/fc0c376af51e4b5195da5ff453026ec9/roles/6666a44189e7493d9de289fe534d6dff` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.954174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.955333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.955829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.956326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.967412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.969911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.976030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=fc0c376af51e4b5195da5ff453026ec9, role_id=6666a44189e7493d9de289fe534d6dff)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.978696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:46.985441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:46.986410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:46.987524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:46.990789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 332/643] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:46.991991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.071013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 312/644] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:46 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/fc0c376af51e4b5195da5ff453026ec9/roles/6666a44189e7493d9de289fe534d6dff => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:47.072619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.181728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.192886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.253731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee2f95-76d7-4d3f-ae53-97a12f7a1b50 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.323887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.324886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.325342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.325772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.326764 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:47.327211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.328847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.339902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 333/645] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:47.351882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.391744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162315-02b0-481d-b870-fa581a7c5c2c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.480692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261a1da-7b0a-4221-8b93-7d26da1af5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.483327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a1da-7b0a-4221-8b93-7d26da1af5df None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.483972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a1da-7b0a-4221-8b93-7d26da1af5df None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.484922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a1da-7b0a-4221-8b93-7d26da1af5df None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.487510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261a1da-7b0a-4221-8b93-7d26da1af5df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:47.488193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261a1da-7b0a-4221-8b93-7d26da1af5df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.492719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261a1da-7b0a-4221-8b93-7d26da1af5df None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.493320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1203-3712-4c5d-82c4-f3a3d8b3e058 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.539054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 313/646] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:47.540837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731f41-2c78-477c-9464-abdab6f5baf6 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.541364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731f41-2c78-477c-9464-abdab6f5baf6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.542130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731f41-2c78-477c-9464-abdab6f5baf6 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.546954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 314/647] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:47.548268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731f41-2c78-477c-9464-abdab6f5baf6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.560980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fed5c-8d1f-4ed4-a65c-21395b30107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.561866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fed5c-8d1f-4ed4-a65c-21395b30107b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.562432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fed5c-8d1f-4ed4-a65c-21395b30107b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.562938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fed5c-8d1f-4ed4-a65c-21395b30107b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.593936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fed5c-8d1f-4ed4-a65c-21395b30107b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.598052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fed5c-8d1f-4ed4-a65c-21395b30107b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.620308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-339fed5c-8d1f-4ed4-a65c-21395b30107b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:47.640047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:47.641065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:47.641925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:47.641925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:47.641925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:47.646725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 334/648] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:47.648692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0badf-f798-4eb7-92ad-e23bf3392a72 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.649513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0badf-f798-4eb7-92ad-e23bf3392a72 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.650022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0badf-f798-4eb7-92ad-e23bf3392a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.680733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-46a0badf-f798-4eb7-92ad-e23bf3392a72 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:47.683389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-46a0badf-f798-4eb7-92ad-e23bf3392a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:47.710117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.726450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731f41-2c78-477c-9464-abdab6f5baf6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.782581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.784193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.784965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.786483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.794612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 335/649] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:47.795712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0badf-f798-4eb7-92ad-e23bf3392a72 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.957062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.957062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.053722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0badf-f798-4eb7-92ad-e23bf3392a72 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.069012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.081604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 315/650] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:48.087917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.132554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.143106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.143782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.144060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.144334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.145062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:48.145379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.146982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.163496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 336/651] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:48.164744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.272335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4514814-8b99-4ee2-97c1-d09ba0945381 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.296568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c717998-cd2d-4d7a-b2b8-bc4734e0ffa8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.321998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.322883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.323166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.323452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.337304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.338966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.345513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8398e-390f-44ad-bb12-e78337970395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.346169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8398e-390f-44ad-bb12-e78337970395 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.346451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8398e-390f-44ad-bb12-e78337970395 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.346766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8398e-390f-44ad-bb12-e78337970395 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.358239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8398e-390f-44ad-bb12-e78337970395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8ea8398e-390f-44ad-bb12-e78337970395 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:48.363604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:48.365256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:48.366077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:48.366736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:48.369200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:48.372958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:48.372958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:48.372958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:48.372958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 316/652] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:48.372958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.374896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 337/653] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:48.376517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a961-f0c9-4f79-b9ef-2c0d260b4f80 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.376907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a961-f0c9-4f79-b9ef-2c0d260b4f80 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.377289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a961-f0c9-4f79-b9ef-2c0d260b4f80 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.379642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 338/654] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:48.384309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a961-f0c9-4f79-b9ef-2c0d260b4f80 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.439391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.470702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.511660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef908a-c427-4f0b-928e-f3a843372df8 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.544068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a961-f0c9-4f79-b9ef-2c0d260b4f80 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.558589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.559849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.560453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.561112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.575909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.579276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.592384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fba27-a498-44fb-94a7-6262ad8066ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.593511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fba27-a498-44fb-94a7-6262ad8066ee None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.594096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fba27-a498-44fb-94a7-6262ad8066ee None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.594703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fba27-a498-44fb-94a7-6262ad8066ee None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.595898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fba27-a498-44fb-94a7-6262ad8066ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:48.596524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fba27-a498-44fb-94a7-6262ad8066ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.600374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fba27-a498-44fb-94a7-6262ad8066ee None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:48.604916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:48.606150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:48.607198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:48.607819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 317/655] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:48.608806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.633221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 339/656] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:48.633221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caabd8-28d5-4e64-8eb9-af36dc16b3a1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.633221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caabd8-28d5-4e64-8eb9-af36dc16b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.633221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caabd8-28d5-4e64-8eb9-af36dc16b3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.657729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-81caabd8-28d5-4e64-8eb9-af36dc16b3a1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:48.659680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-81caabd8-28d5-4e64-8eb9-af36dc16b3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:48.753814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 340/657] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:48.755227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caabd8-28d5-4e64-8eb9-af36dc16b3a1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.764364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ab13-bfd9-4148-82b3-87606afa4f8d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.765985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.805928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.810305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.810931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.811213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.811485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.812161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:48.812464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.814287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.829138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 318/658] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:48.829138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.881779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caabd8-28d5-4e64-8eb9-af36dc16b3a1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.920897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.921891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.922403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.922917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.923964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:48.924507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.926272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.946881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 341/659] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:48.948165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.986399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbd383-0a79-4062-a45b-31102c397546 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.031061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.031732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.032019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.032292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.042603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:49.056440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.057378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 319/660] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.058931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.063368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.067946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76615fc-50eb-407c-a490-726510a9c8c3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.086563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.124504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.125333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.125646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.125948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.138276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.140027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:49.158337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.159548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:49.160645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:49.160645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.160645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:49.164924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 342/661] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.165786 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.199843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be91d8-28d3-4ccc-b604-111fb862b28a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.251379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.252116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.252413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.252841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.294247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf97d6-a1a6-42f6-b968-051868cd9657 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.340121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.340653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.341003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.341262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.342930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.344423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.352905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.354508 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:49.370671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.371826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:49.374041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:49.374041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.374041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:49.374041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 343/662] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.374468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.374551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.377358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.469342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 320/663] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:49.471020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.483254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac60c8e-50d0-4142-9503-d036f785a98e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.529370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d8efc-795f-4c37-993a-7f0eb4779623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.529993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8efc-795f-4c37-993a-7f0eb4779623 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.530278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8efc-795f-4c37-993a-7f0eb4779623 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.530557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8efc-795f-4c37-993a-7f0eb4779623 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.531292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d8efc-795f-4c37-993a-7f0eb4779623 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.531602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d8efc-795f-4c37-993a-7f0eb4779623 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.533155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d8efc-795f-4c37-993a-7f0eb4779623 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.546903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 344/664] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.548658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4883-0238-430a-a990-de813236e3bb None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.548952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4883-0238-430a-a990-de813236e3bb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.549223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4883-0238-430a-a990-de813236e3bb None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.550503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 345/665] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:49.551346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa4883-0238-430a-a990-de813236e3bb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.616045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b38a5-7b7a-4a1e-8257-bb6d0d6e8314 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.633958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.640527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.652492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.659457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.659457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.659457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.659457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.659457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.659457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.669655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 321/666] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.670933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.685250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa4883-0238-430a-a990-de813236e3bb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.720795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.721415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.721697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.721973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.722620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.722958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.724888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.736987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 346/667] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.737828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.784094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869354-1250-46e8-ad09-d30421b692ed None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.821248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92941f14-dd6c-46ed-bf17-bd9058497d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.824026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941f14-dd6c-46ed-bf17-bd9058497d90 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.824026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941f14-dd6c-46ed-bf17-bd9058497d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.824026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941f14-dd6c-46ed-bf17-bd9058497d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.833428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92941f14-dd6c-46ed-bf17-bd9058497d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.834923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92941f14-dd6c-46ed-bf17-bd9058497d90 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.854892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3eab52-4b8b-4160-bc4c-4bc7db7c5051 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-92941f14-dd6c-46ed-bf17-bd9058497d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:49.858963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.860853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:49.862857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:49.862857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.862857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:49.862857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 322/668] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.862857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c01a2-ccf2-4aac-b179-1dcb39e9c3d3 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.862857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c01a2-ccf2-4aac-b179-1dcb39e9c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.862857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c01a2-ccf2-4aac-b179-1dcb39e9c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.881664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.881998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4b2c01a2-ccf2-4aac-b179-1dcb39e9c3d3 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:49.883256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4b2c01a2-ccf2-4aac-b179-1dcb39e9c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:49.899113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.904734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.904734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.904734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.904734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=a78694291dba47f1b833c721cb728460) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.904734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.904734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.909665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 347/669] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/role_assignments?user.id=a78694291dba47f1b833c721cb728460&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.910740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.928975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.000766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 323/670] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:50.011774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c01a2-ccf2-4aac-b179-1dcb39e9c3d3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.061187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff554818-1549-44e7-86cf-77d80b9afa78 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.105096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.106388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.107581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.107581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.132393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.132393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:50.143277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:50.144839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 348/671] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:50.147531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.185149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c01a2-ccf2-4aac-b179-1dcb39e9c3d3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.204307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.234203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.234873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.235150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.235432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.236109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.238382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.295866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13677b2-64b0-49b9-9741-5e8e652d2e15 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.330164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 324/672] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:50 2022] POST /identity/v3/users => generated 254 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:50.331167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.365007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.366239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.366740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.367638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.367893 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.369676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:50.370466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.372758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.404271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 349/673] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:50.406047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.517360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfdf1f-0459-433b-be4b-d89b4995ee97 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.570759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.571551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.571852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.572192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.572861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:50.573275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.575813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.588686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965ccc-6529-4a88-8a74-558609540ad0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.598918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.604309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 325/674] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:50.606745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.634919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.635822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.636267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.636700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.658286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:50.663617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:50.664647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:50.665465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:50.668085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 350/675] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:50.674318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.741748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.767548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fdbb2-f058-468e-ae44-a7ef204edb16 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.812770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.814302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.814878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.815388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.824215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.826125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.836652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bb3f0-8204-4c90-9313-8bcf1907b810 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:50.840786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:50.841766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:50.842691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:50.846174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 326/676] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:50.847499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.904277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.905170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.905638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.906093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.968782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.974112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5aa0a-2735-4856-9a98-67313f11dd3e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.011191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.012834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.018471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.019714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.020633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.021720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.023297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.023943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.026409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.045571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 327/677] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.047833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.054951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.132381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 351/678] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:51.133617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.212047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.232330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16810-ab41-4cc4-ad7a-6606740eefcd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.250855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8fb2-c18e-4d97-9f33-73799dae9706 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.274445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.275225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.275561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.275843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.276623 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.276938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.279401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.294853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.295987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.296526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.297213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.305938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 328/679] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.306859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.314206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.317943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:51.336630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:51.337625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:51.338987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:51.338987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:51.338987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:51.341048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 352/680] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:51.342214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.387736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.435410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6755e5-d624-4fd1-9433-60f335764801 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.460683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d768f-1e24-440c-be21-e5c8a4fe9eef None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.475381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.476035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.476378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.476717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.481207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.497142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.497142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.501441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.502484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.503004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.503487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.505076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=765ee8241c4e448eb999016b17132e37) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.505618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.507321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:51.510214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:51.511199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:51.512064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:51.512064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:51.512064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:51.512064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 329/681] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:51.512753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.517837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 353/682] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/role_assignments?user.id=765ee8241c4e448eb999016b17132e37&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.519071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.647933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba1a49-3501-40f1-8e44-17de96bc9221 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.653081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe01dc-f119-44bc-a9f7-ce1b139dfbea None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.675073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.706578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.708383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.709474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.710454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.711094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.711617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.712091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.712565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.713630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.714618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.715250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.715774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.717425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.719275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.738116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 354/683] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.744648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.767296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 330/684] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.786128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.827492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.935761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e715-012a-4990-ace0-8702ddc8a243 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.980637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.981296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.981573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.981967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.991495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.993321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.007756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3e74d-7048-4202-99ec-f562a23a6bc3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:52.008191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:52.009017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:52.009869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 355/685] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:52.019802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.118548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.119680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.120186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.120671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.144678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.148060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.317069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6fa46-38b1-49b1-802f-34eabfc5d66f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.320265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:52.365446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:52.367346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:52.369184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:52.374026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 331/686] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 589 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:52.385700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.407382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.408009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.408321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.409135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.409295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:52.409551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.411603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.437833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 356/687] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:52.443780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.477788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.647586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02d98-a865-48bf-adb0-7dbeec0b9084 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.736668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830872b0-4301-44cb-b3a4-ea61953395a6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.737635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c93d-6e10-48d3-809e-6dc9ef39d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.740077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c93d-6e10-48d3-809e-6dc9ef39d7ee None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.740883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c93d-6e10-48d3-809e-6dc9ef39d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.741648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c93d-6e10-48d3-809e-6dc9ef39d7ee None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.743438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c93d-6e10-48d3-809e-6dc9ef39d7ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:52.745875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c93d-6e10-48d3-809e-6dc9ef39d7ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.749169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c93d-6e10-48d3-809e-6dc9ef39d7ee None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.773742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 332/688] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:52.780246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131c75-bfb0-4ead-b5a5-3d56401f6176 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.780522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131c75-bfb0-4ead-b5a5-3d56401f6176 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.780886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131c75-bfb0-4ead-b5a5-3d56401f6176 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.782818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 333/689] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:52.783592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3131c75-bfb0-4ead-b5a5-3d56401f6176 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.826749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90490-17fc-447b-90c6-c526b4b754e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.828269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90490-17fc-447b-90c6-c526b4b754e7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.829050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90490-17fc-447b-90c6-c526b4b754e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.829799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90490-17fc-447b-90c6-c526b4b754e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.831462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90490-17fc-447b-90c6-c526b4b754e7 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=0ac7372634fa47df8d7fb36c98f7e0ad) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:52.832464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90490-17fc-447b-90c6-c526b4b754e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.835526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90490-17fc-447b-90c6-c526b4b754e7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.847556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 357/690] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/role_assignments?user.id=0ac7372634fa47df8d7fb36c98f7e0ad&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 608 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:52.850653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66dd4-90ad-40e6-be28-caeb38041b0d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.851148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66dd4-90ad-40e6-be28-caeb38041b0d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.851639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66dd4-90ad-40e6-be28-caeb38041b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.884897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-45b66dd4-90ad-40e6-be28-caeb38041b0d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:52.887056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-45b66dd4-90ad-40e6-be28-caeb38041b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:52.902673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.919688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3131c75-bfb0-4ead-b5a5-3d56401f6176 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.932454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.974447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.975410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.975853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.976279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.040327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 358/691] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:53.040327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52330ce-6334-4125-a860-052c56bb8bb3 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.040327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52330ce-6334-4125-a860-052c56bb8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.040327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52330ce-6334-4125-a860-052c56bb8bb3 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.041487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 359/692] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:53.047425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6ae9-1ba7-43f8-872d-27d456ae6791 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.047767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6ae9-1ba7-43f8-872d-27d456ae6791 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.048124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6ae9-1ba7-43f8-872d-27d456ae6791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.070096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a53d6ae9-1ba7-43f8-872d-27d456ae6791 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:53.071477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a53d6ae9-1ba7-43f8-872d-27d456ae6791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:53.107715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.111528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.155871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 360/693] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:53.300935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.324657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 334/694] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:53.330576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d6ae9-1ba7-43f8-872d-27d456ae6791 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.454719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.472380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d6ae9-1ba7-43f8-872d-27d456ae6791 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.505622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.517802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.517802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.517802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.517802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.550654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.553979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:53.584243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:53.586303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:53.588424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:53.588424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:53.588424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:53.591522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 361/695] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:53.596779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.697434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06e7e3-428f-4499-88fe-f7f396257960 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.717697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288949c7-6a1e-44e6-9187-936e350bd102 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.741392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.742064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.742319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.742601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.759812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:53.765293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.765949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.766235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:53.766424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:53.767335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:53.768140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:53.768757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.771633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 335/696] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:53.772818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.783493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.791280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:53.800918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:53.803218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:53.804036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:53.804653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 362/697] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:53.805661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.864245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.952878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f71332-ea62-442e-a1b0-b72be5319fee None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.989032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58870574-7c2e-4bb2-9afe-f01916fb7455 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.998926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.999912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.000413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.000906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.001775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:54.002274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.003988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.015391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 363/698] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:54.016630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.056831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.057541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.057828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.058107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.058904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:54.059254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.060880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.081855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 336/699] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:54.083109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.092458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.142554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04965d-7b50-4b61-bab5-b46af36bb353 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.188759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.190046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.190556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.191178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.193016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:54.193683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.195396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.206187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 364/700] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:54.208087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.254472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bed9d0-890a-4e5a-a489-796d915d058b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.283883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.327096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.328142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.329379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.329927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.346738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.350300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:54.371982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:54.373022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:54.373936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:54.373936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:54.373936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:54.374122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7dffc-e3c7-4036-9dc5-c8fddbd1ff58 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.377810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 337/701] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:54.379139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.421196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.434981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.437619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.437619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.437619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.444188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.445656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:54.458824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:54.460012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:54.461068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:54.463470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 365/702] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:54.464265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.546482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa1c40-fdbb-46a6-853b-3b6382a51b91 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.589358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc174-b59f-49d2-a372-80893a00a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.590017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc174-b59f-49d2-a372-80893a00a629 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.590305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc174-b59f-49d2-a372-80893a00a629 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.590560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc174-b59f-49d2-a372-80893a00a629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.595057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb04b-3e45-4b09-b891-fc8bd58b6ca5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.603848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cc174-b59f-49d2-a372-80893a00a629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.605396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cc174-b59f-49d2-a372-80893a00a629 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-920cc174-b59f-49d2-a372-80893a00a629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:54.623787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:54.624892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:54.627307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:54.627307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:54.627307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:54.627307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 338/703] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:54.627307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f5b3a-7a3a-4778-ab40-7bf1fdcbc8ca None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.627307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f5b3a-7a3a-4778-ab40-7bf1fdcbc8ca None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.627307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f5b3a-7a3a-4778-ab40-7bf1fdcbc8ca None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.632293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 339/704] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:54.633226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f5b3a-7a3a-4778-ab40-7bf1fdcbc8ca None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.649219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e94aa-fe29-4473-9ab8-8cd28e7ebcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.650105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e94aa-fe29-4473-9ab8-8cd28e7ebcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.650748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e94aa-fe29-4473-9ab8-8cd28e7ebcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.651190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e94aa-fe29-4473-9ab8-8cd28e7ebcb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.652380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e94aa-fe29-4473-9ab8-8cd28e7ebcb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:54.652977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e94aa-fe29-4473-9ab8-8cd28e7ebcb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.655185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e94aa-fe29-4473-9ab8-8cd28e7ebcb8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.656504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.672810 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 366/705] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:54.680285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7e728-875f-45b6-a23f-60cc0f159ceb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.680572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7e728-875f-45b6-a23f-60cc0f159ceb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.680850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7e728-875f-45b6-a23f-60cc0f159ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.702699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2fe7e728-875f-45b6-a23f-60cc0f159ceb None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:54.703920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2fe7e728-875f-45b6-a23f-60cc0f159ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:54.756330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.800859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 367/706] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:54.803666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7e728-875f-45b6-a23f-60cc0f159ceb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.808835 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f5b3a-7a3a-4778-ab40-7bf1fdcbc8ca None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.883583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.884796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.885357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.885919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.887276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:54.887911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.891602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.916333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 340/707] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:54.917877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.039309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7e728-875f-45b6-a23f-60cc0f159ceb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.088596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.120793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.121843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.122347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.122877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.124087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:55.124634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.127278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.130097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a4e8-a8ab-4b16-b048-c8cd49cabce5 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.154213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 368/708] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:55.154213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.198195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.199367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.199889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.200400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.213341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.215059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.217790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:55.232182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:55.234043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 341/709] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:55.235992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.327125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943046-d776-4448-9e40-fdcfa0b8cb1e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.401308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3976e-f402-4c27-a480-7f565369c679 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.404867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.405699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.406034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.406359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.407434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=fc0c376af51e4b5195da5ff453026ec9) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:55.407943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.410517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.421171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 369/710] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/role_assignments?user.id=fc0c376af51e4b5195da5ff453026ec9&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:55.422409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.462493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.463520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.463943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.464390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.465376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.467595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.474951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:55.484368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:55.491327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:55.492347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 342/711] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:55.493562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.582032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.592471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aaa84-8466-4b43-bfaf-f91a609d5343 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.641348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b626fc1-4ecc-4403-8ef6-8bf8a7fac7c7 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.655518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549ecd-bca0-4e65-a8bc-f40f45063bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.656483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549ecd-bca0-4e65-a8bc-f40f45063bee None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.656962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549ecd-bca0-4e65-a8bc-f40f45063bee None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.657421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549ecd-bca0-4e65-a8bc-f40f45063bee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.674358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549ecd-bca0-4e65-a8bc-f40f45063bee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.677351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549ecd-bca0-4e65-a8bc-f40f45063bee None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e3549ecd-bca0-4e65-a8bc-f40f45063bee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:55.701881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:55.703152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:55.704316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 370/712] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:55.705918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b26f9-5fb4-47f8-825d-e4ab6fbbca77 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.706358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b26f9-5fb4-47f8-825d-e4ab6fbbca77 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.706813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b26f9-5fb4-47f8-825d-e4ab6fbbca77 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.709171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 371/713] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:55.710035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b26f9-5fb4-47f8-825d-e4ab6fbbca77 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.724569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065247-539e-4a1c-b426-17b1cd4166ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.725542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065247-539e-4a1c-b426-17b1cd4166ec None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.726441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065247-539e-4a1c-b426-17b1cd4166ec None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.726441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065247-539e-4a1c-b426-17b1cd4166ec None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.727447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0065247-539e-4a1c-b426-17b1cd4166ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:55.727805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0065247-539e-4a1c-b426-17b1cd4166ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.729328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0065247-539e-4a1c-b426-17b1cd4166ec None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.760653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 343/714] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:55.763348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8b095-6c67-4051-9ce7-aa65b573f518 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.763684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8b095-6c67-4051-9ce7-aa65b573f518 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.763956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8b095-6c67-4051-9ce7-aa65b573f518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.783811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-05e8b095-6c67-4051-9ce7-aa65b573f518 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:55.785044 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-05e8b095-6c67-4051-9ce7-aa65b573f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:55.869470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.898681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 344/715] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:55.898953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b26f9-5fb4-47f8-825d-e4ab6fbbca77 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.899112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8b095-6c67-4051-9ce7-aa65b573f518 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.967509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.968599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.969218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.969822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.971121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] RBAC: Adding query filter params (name=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:55.971787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.974551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.990732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 372/716] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:55.992494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.034013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.070917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8b095-6c67-4051-9ce7-aa65b573f518 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.115447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.116072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.116356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.116628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.117372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:56.117674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.119274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.144290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 345/717] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:56.146899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.186374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b395c4-fc7e-4a23-a3c3-a67df426ec11 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.205317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.249842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.250873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.251430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.252047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.273742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37270093-8330-47dc-9b69-9511349ea606 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.318102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.319506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.320975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.321413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.322291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] RBAC: Adding query filter params (type=network) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:56.322787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.324311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.332050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 346/718] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:56.333753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.429922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.432845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.472729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270754-9799-4c9c-902b-07d69c33ab4a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.473790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.489282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.520507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.521662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.522138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.522733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.618444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.621427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.632152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 373/719] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:56.633647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.823878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 347/720] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:56.825315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.826141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6717-518d-453c-a34c-d9ccd75c97c5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.848718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.866053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.889337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.890373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.890901 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.891369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.892370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.895403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:56.915325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:56.917349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:00:56.919602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:56.924964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 374/721] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:56.926547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.030982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175aa07-8485-44a1-a2c3-27f8341a124d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.070491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.071201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.071483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.072195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.084304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.085868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:57.103000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:57.105211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:57.107195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:57.107195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:57.107195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:57.110872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 348/722] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:57.111965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.117728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e351712-29e3-41c4-9371-043b4ec8a321 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.182924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.192471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.200458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.200458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.200458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.217366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.221412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.227613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49654686-43ee-43ab-9afb-4c134ada291d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:57.250861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:57.252731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:57.255016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:57.255016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:57.255016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:57.258898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 375/723] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:57.260926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.266600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.267372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.267720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.268076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.270158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:57.270158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.271241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.282666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 349/724] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:57.282666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.349139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.392473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a8b4-137e-40cf-a87f-53bd2a9756b3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.422200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.432262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ae0b1-c470-43be-ba23-bf219afc2ec5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.436345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.436345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.436345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.436345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.436705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:57.436705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.436705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.450241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 350/725] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:57.451170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.484146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.485930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.486556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.487280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.489269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:57.489814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.492225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.511356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 376/726] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:57.513141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.586910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11323f-1771-4c17-923a-ce71dc5b4652 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.641588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.642652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.643266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.643858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.645599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:57.646300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.648942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.664011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 351/727] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:57.664011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.692125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.705258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a69c9b-f642-4155-999b-0d8c8a3f1cf4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.773976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf42739-f1c0-426d-a160-c9561cc76594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.774657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42739-f1c0-426d-a160-c9561cc76594 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.774968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42739-f1c0-426d-a160-c9561cc76594 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.775357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42739-f1c0-426d-a160-c9561cc76594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.784372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf42739-f1c0-426d-a160-c9561cc76594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.786548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf42739-f1c0-426d-a160-c9561cc76594 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ecf42739-f1c0-426d-a160-c9561cc76594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:57.800100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:57.801944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:57.804246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:00:57.806788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 377/728] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:57.810717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf610-948f-4d20-8dcd-2689af284254 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.810717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf610-948f-4d20-8dcd-2689af284254 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.810717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf610-948f-4d20-8dcd-2689af284254 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.810717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 378/729] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:57.812224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.817341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf610-948f-4d20-8dcd-2689af284254 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.902507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d09584-8593-4fe2-b962-e3d6b69a65f3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.943304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf610-948f-4d20-8dcd-2689af284254 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.964597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826d69d-b22c-49f2-a9d2-5404e21d853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.965620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826d69d-b22c-49f2-a9d2-5404e21d853d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.966077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826d69d-b22c-49f2-a9d2-5404e21d853d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.966530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826d69d-b22c-49f2-a9d2-5404e21d853d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.982112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826d69d-b22c-49f2-a9d2-5404e21d853d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.982112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826d69d-b22c-49f2-a9d2-5404e21d853d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-3826d69d-b22c-49f2-a9d2-5404e21d853d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:58.004801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:58.005760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:58.006621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:58.008882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 352/730] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:58.011736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b5778-1dff-4856-9368-aebe43f77638 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.012247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b5778-1dff-4856-9368-aebe43f77638 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.012951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b5778-1dff-4856-9368-aebe43f77638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.018100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.019090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.019576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.020118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.021081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:58.021635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.023481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.042774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 379/731] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:58.044138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.049857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-219b5778-1dff-4856-9368-aebe43f77638 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:58.051939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-219b5778-1dff-4856-9368-aebe43f77638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:58.066231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.184935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b58c5-9183-41de-98a8-be85da0990b7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.200009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 353/732] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:58.200009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b5778-1dff-4856-9368-aebe43f77638 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.273087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.274653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.275210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.275787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.276897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:58.277482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.280114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.285281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.303577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 380/733] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:58.312441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.407789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b5778-1dff-4856-9368-aebe43f77638 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.480731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.481620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.482127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.482608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.484093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=31e687163dec4063a3932d164b06654e) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:58.484784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.487606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.497775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.500604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 354/734] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/role_assignments?user.id=31e687163dec4063a3932d164b06654e&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:58.553032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4c540-cdd1-4115-afbe-1a4d1979eb1d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.631321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e53f9b-2b03-4461-bb38-24018e088006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.632341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e53f9b-2b03-4461-bb38-24018e088006 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.632804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e53f9b-2b03-4461-bb38-24018e088006 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.633221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e53f9b-2b03-4461-bb38-24018e088006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.634392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e53f9b-2b03-4461-bb38-24018e088006 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=a78694291dba47f1b833c721cb728460) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:58.634915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e53f9b-2b03-4461-bb38-24018e088006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.637482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e53f9b-2b03-4461-bb38-24018e088006 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.654477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 381/735] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/role_assignments?user.id=a78694291dba47f1b833c721cb728460&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:58.813909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.843116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e966-7cbe-4954-ae9c-2b7a1de8d362 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.843481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e966-7cbe-4954-ae9c-2b7a1de8d362 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.843676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e966-7cbe-4954-ae9c-2b7a1de8d362 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.845399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 382/736] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:58.851965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5118e-5a76-4a34-bb76-a1dc5ff672cc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.852602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5118e-5a76-4a34-bb76-a1dc5ff672cc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.853156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5118e-5a76-4a34-bb76-a1dc5ff672cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.888659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-12b5118e-5a76-4a34-bb76-a1dc5ff672cc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:58.890332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-12b5118e-5a76-4a34-bb76-a1dc5ff672cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:58.997492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 383/737] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:59.000194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f649e4-63bd-42af-a1c5-cb37a776f258 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.003707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.064541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.065407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.065803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.066305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.092996 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:59.105688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:59.106702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:59.107523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:59.108194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 355/738] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:59.117411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5118e-5a76-4a34-bb76-a1dc5ff672cc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.243516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.281393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5118e-5a76-4a34-bb76-a1dc5ff672cc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.324767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.325652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.326081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.326501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.327465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:59.327928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.329500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.340969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 384/739] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:59.349960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.605041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.626234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b115d5-4515-4afe-a5bf-9ff6b6b8670f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.720381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.721031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.721310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.721586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.741708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.743924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:59.775358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:59.776333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:59.777193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:59.777193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:59.777193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:00:59.777193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 356/740] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:59.789213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.839774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04648ca-824a-4aaa-b15f-3ed60faaec91 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.843177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.905213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.914595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.915268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.915684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.915831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.916430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.917836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.981381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a301-98d5-4490-808a-00b086bba1a2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.032639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.033700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.034210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.034741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.036714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:00.037278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.040129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.059421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 385/741] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:00:59 2022] POST /identity/v3/services => generated 240 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:00.072040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 357/742] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:00.076697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.292734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52902765-29cc-4a44-8918-c1bdfb60d363 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.366837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077952ea-ba56-462e-a54a-ba2b2afe7f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.368437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077952ea-ba56-462e-a54a-ba2b2afe7f4a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.369223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077952ea-ba56-462e-a54a-ba2b2afe7f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.370044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077952ea-ba56-462e-a54a-ba2b2afe7f4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.385997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077952ea-ba56-462e-a54a-ba2b2afe7f4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.389350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077952ea-ba56-462e-a54a-ba2b2afe7f4a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-077952ea-ba56-462e-a54a-ba2b2afe7f4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:00.416048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:00.418010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:00.422973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 386/743] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:00.433307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.593241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae345-eec3-413e-9762-1f65d7aa64e3 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.593739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae345-eec3-413e-9762-1f65d7aa64e3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.594235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae345-eec3-413e-9762-1f65d7aa64e3 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.596938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 387/744] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:00.600129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:00.606664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b321c-71b8-4e75-9fd5-a92cf1b5cbc6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.606664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b321c-71b8-4e75-9fd5-a92cf1b5cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.606664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b321c-71b8-4e75-9fd5-a92cf1b5cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.625934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cd2b321c-71b8-4e75-9fd5-a92cf1b5cbc6 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:00.627620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cd2b321c-71b8-4e75-9fd5-a92cf1b5cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:00.654611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421bbf-5c15-4ffb-a3eb-58070c000eff None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.708372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:00.726615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 388/745] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:00 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:01:00.764507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.765147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.765433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.765723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.766458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:00.766801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.768252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.801880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 358/746] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:00.811390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b321c-71b8-4e75-9fd5-a92cf1b5cbc6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.974394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b321c-71b8-4e75-9fd5-a92cf1b5cbc6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.027219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.028538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.029035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.029543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.101226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.126207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.133997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.164486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.244685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 389/747] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 20:01:01.255008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.372638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.427092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309914a-9272-4fbc-9104-1aa41f42d260 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.438430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373391a-83a2-4f3d-ac5c-65364c09adfa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.473699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d75c6-f561-4afa-83e9-c94865181fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.474319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d75c6-f561-4afa-83e9-c94865181fa0 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.474599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d75c6-f561-4afa-83e9-c94865181fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.476479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d75c6-f561-4afa-83e9-c94865181fa0 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.477160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d75c6-f561-4afa-83e9-c94865181fa0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.479582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d75c6-f561-4afa-83e9-c94865181fa0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.486807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.512256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.512805 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.513094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.513349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.526144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.527667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:01.545602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:01.547517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:01.549324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:01.549324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:01.549324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:01.549324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 390/748] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:01.559289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 359/749] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:01 2022] POST /identity/v3/services => generated 251 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:01:01.560050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.651969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4fe59-c21a-4d28-babb-b6f6e926b940 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.652471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4fe59-c21a-4d28-babb-b6f6e926b940 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.652961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4fe59-c21a-4d28-babb-b6f6e926b940 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.660038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 360/750] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:01.670999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ead7-c5b7-4dff-9038-cb3a6034e3f8 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.688182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ead7-c5b7-4dff-9038-cb3a6034e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.688678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ead7-c5b7-4dff-9038-cb3a6034e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.694591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7917b-770d-4a16-8051-2048e9ac5cb1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.729729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.731509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2fc6ead7-c5b7-4dff-9038-cb3a6034e3f8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:01.732887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2fc6ead7-c5b7-4dff-9038-cb3a6034e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:01.763917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516895-3cea-437e-a623-cfd7b1f34c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.764870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516895-3cea-437e-a623-cfd7b1f34c84 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.765171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516895-3cea-437e-a623-cfd7b1f34c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.765442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516895-3cea-437e-a623-cfd7b1f34c84 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.766115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516895-3cea-437e-a623-cfd7b1f34c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:01.766423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516895-3cea-437e-a623-cfd7b1f34c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.768313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516895-3cea-437e-a623-cfd7b1f34c84 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.800651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 391/751] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:01.809641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac623-3719-45a5-8ace-e6e9c8a0e153 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.810128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac623-3719-45a5-8ace-e6e9c8a0e153 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.810428 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac623-3719-45a5-8ace-e6e9c8a0e153 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.815564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 392/752] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:01.821639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cac623-3719-45a5-8ace-e6e9c8a0e153 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.856685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 361/753] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:01.858184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f594c4-5d93-4b71-944a-a6e88551a8f4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.858486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f594c4-5d93-4b71-944a-a6e88551a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.858801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f594c4-5d93-4b71-944a-a6e88551a8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.879730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-90f594c4-5d93-4b71-944a-a6e88551a8f4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:01.881191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-90f594c4-5d93-4b71-944a-a6e88551a8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:01.943542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cac623-3719-45a5-8ace-e6e9c8a0e153 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.962110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 362/754] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:01.985371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.986021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.986308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.986581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.994984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.996460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:02.009445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:02.012729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:02.016480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 393/755] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:02.018309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f594c4-5d93-4b71-944a-a6e88551a8f4 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.083312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.166813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f594c4-5d93-4b71-944a-a6e88551a8f4 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.219608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.227447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.228446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.228962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.229462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.230387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.230939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.232614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.258066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 363/756] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:02.284196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.307214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.364604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d39a-d9c3-4122-ab24-b27938e31077 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.402231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.403117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.403535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.403792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.418559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a6ff3-1cc9-4256-b8e0-af1bbbe4be38 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.419134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:02.427215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:02.428254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:02.429080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:02.430140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 394/757] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:02.430758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.447447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.481991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.483383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.484078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.484729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.487895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=fc0c376af51e4b5195da5ff453026ec9) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.489401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.492662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.503732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 364/758] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/role_assignments?user.id=fc0c376af51e4b5195da5ff453026ec9&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:02.506146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.637539 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61064-b72e-4869-9941-337b927ed325 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.667264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.719737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.720389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.720666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.720933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.750238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:02.758441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:02.759456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:02.760269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:02.761454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 395/759] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:02.771997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.783276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ccf9c-dd49-4943-9714-9e5c08b52f09 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.872923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.873559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.873844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.874124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.874859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.875172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.876592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.887396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 365/760] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:02.899299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.022927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.027842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2c365-0a2f-45de-b49f-b2ff1105eb11 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.118283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.119273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.120084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.121911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.123144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:03.123612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.125945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.146524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 396/761] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:03.153531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.200567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daaebd-a168-45bd-bd0e-bfe7b6ca60e4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.226956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.274588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.275280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.275567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.275846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.303721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.305214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:03.337803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:03.338838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:03.340774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:03.340774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:03.340774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:03.340774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 366/762] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:03.345462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.361798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b757f2-c490-4f28-a05b-48650c9ed551 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.409550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebbb9d-bc38-41e0-b6a8-c629154677ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.414279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebbb9d-bc38-41e0-b6a8-c629154677ec None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.414566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebbb9d-bc38-41e0-b6a8-c629154677ec None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.414767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebbb9d-bc38-41e0-b6a8-c629154677ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.435606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebbb9d-bc38-41e0-b6a8-c629154677ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.437505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebbb9d-bc38-41e0-b6a8-c629154677ec None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-02ebbb9d-bc38-41e0-b6a8-c629154677ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:03.458517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:03.459580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:03.460462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:03.460462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:03.460462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:03.460462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 397/763] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:03.461396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397992c-30ef-4a27-8d9a-d609e06c7d3f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.461684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397992c-30ef-4a27-8d9a-d609e06c7d3f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.462001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397992c-30ef-4a27-8d9a-d609e06c7d3f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.466728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 398/764] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:03.467635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397992c-30ef-4a27-8d9a-d609e06c7d3f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.495103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.510450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955a488-bc96-4d25-9ead-34eb4e032a43 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.569154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49b7e-bcb5-481b-8914-2ed9e67ec632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.569918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49b7e-bcb5-481b-8914-2ed9e67ec632 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.570207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49b7e-bcb5-481b-8914-2ed9e67ec632 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.570618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49b7e-bcb5-481b-8914-2ed9e67ec632 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.572087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49b7e-bcb5-481b-8914-2ed9e67ec632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:03.572502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49b7e-bcb5-481b-8914-2ed9e67ec632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.575403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49b7e-bcb5-481b-8914-2ed9e67ec632 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.594763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 367/765] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:03.594763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b8fb9-1a37-4843-94eb-7b4c7a189e3a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.594763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b8fb9-1a37-4843-94eb-7b4c7a189e3a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.594763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b8fb9-1a37-4843-94eb-7b4c7a189e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.610729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.625188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2d1b8fb9-1a37-4843-94eb-7b4c7a189e3a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:03.627771 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2d1b8fb9-1a37-4843-94eb-7b4c7a189e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:03.668502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397992c-30ef-4a27-8d9a-d609e06c7d3f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.726728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 368/766] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:03.727875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b8fb9-1a37-4843-94eb-7b4c7a189e3a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.749833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.750481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.750793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.751103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.751724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:03.752032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.758724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.786826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 399/767] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:03.794003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.899164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.936538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b8fb9-1a37-4843-94eb-7b4c7a189e3a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.995298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.996055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.996542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.996837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.007234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.008734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:04.022869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:04.023891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:04.024921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:04.025449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 369/768] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:04.032263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.034596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c419d-baca-4e00-91c2-87199d110c72 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.131461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.132139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.132433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.132714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.147776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.149299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.152443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.162185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fcf5b-afd4-4404-9383-270cd5d3f63b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:04.164938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:04.171408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:04.172360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:04.173495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 400/769] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:04.174847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.207254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497423d-e1bc-48f1-a229-c0309b5fc01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.207803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497423d-e1bc-48f1-a229-c0309b5fc01c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.208337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497423d-e1bc-48f1-a229-c0309b5fc01c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.208337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497423d-e1bc-48f1-a229-c0309b5fc01c None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.209121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497423d-e1bc-48f1-a229-c0309b5fc01c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:04.209437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497423d-e1bc-48f1-a229-c0309b5fc01c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.211147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497423d-e1bc-48f1-a229-c0309b5fc01c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.230966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.234092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 370/770] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:04.235312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb163-9a12-4b62-88e6-85320b19f5c5 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.235982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb163-9a12-4b62-88e6-85320b19f5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.236367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb163-9a12-4b62-88e6-85320b19f5c5 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.238768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 371/771] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:04.239702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcb163-9a12-4b62-88e6-85320b19f5c5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.347309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643eba6-b5cd-41ef-aef4-47f003262e97 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.365634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcb163-9a12-4b62-88e6-85320b19f5c5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.399942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.401024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.401532 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.402013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.403142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.405996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.406147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498279f-73b3-4ad7-ae71-f25cd3953da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.406844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498279f-73b3-4ad7-ae71-f25cd3953da2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.407162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498279f-73b3-4ad7-ae71-f25cd3953da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.407444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498279f-73b3-4ad7-ae71-f25cd3953da2 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.408202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498279f-73b3-4ad7-ae71-f25cd3953da2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:04.408512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498279f-73b3-4ad7-ae71-f25cd3953da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.410112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498279f-73b3-4ad7-ae71-f25cd3953da2 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:04.423084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:04.424476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:04.425330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:04.427858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 401/772] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:04.427858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.433489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 372/773] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:04.435356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe0678-9fd1-48bb-962c-51ae59757909 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.435938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe0678-9fd1-48bb-962c-51ae59757909 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.436422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe0678-9fd1-48bb-962c-51ae59757909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.458508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-cbbe0678-9fd1-48bb-962c-51ae59757909 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:04.459706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-cbbe0678-9fd1-48bb-962c-51ae59757909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:04.522146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.539224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 373/774] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:04.540093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe0678-9fd1-48bb-962c-51ae59757909 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.565397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.653642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033a2c-018c-4422-9aa1-5a1319bda3d3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.729756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.730780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.731291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.731779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.737630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe0678-9fd1-48bb-962c-51ae59757909 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.751528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.754939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:04.784582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:04.785644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:04.787260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:04.787260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:04.787260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:04.787260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 402/775] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:04.788083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.804318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f01467-6a26-4af8-8259-4bf483cb9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.805343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01467-6a26-4af8-8259-4bf483cb9fbc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.806554 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01467-6a26-4af8-8259-4bf483cb9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.807087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01467-6a26-4af8-8259-4bf483cb9fbc None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.807882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f01467-6a26-4af8-8259-4bf483cb9fbc None admin] RBAC: Adding query filter params (name=network) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:04.808481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f01467-6a26-4af8-8259-4bf483cb9fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.810903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f01467-6a26-4af8-8259-4bf483cb9fbc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.817868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 374/776] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:04.819603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ff91-0657-48c1-89a5-ff921c9fa609 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.820181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ff91-0657-48c1-89a5-ff921c9fa609 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.820453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ff91-0657-48c1-89a5-ff921c9fa609 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.821977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 375/777] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:04.823906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67ff91-0657-48c1-89a5-ff921c9fa609 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.917570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.958592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c2fdc-e63b-4502-bec2-63baac870772 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.981314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.997056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67ff91-0657-48c1-89a5-ff921c9fa609 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.006266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b804c3-8a6e-46d1-aff3-2b85551df7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.007093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b804c3-8a6e-46d1-aff3-2b85551df7db None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.007555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b804c3-8a6e-46d1-aff3-2b85551df7db None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.007960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b804c3-8a6e-46d1-aff3-2b85551df7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.021554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b804c3-8a6e-46d1-aff3-2b85551df7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.023371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b804c3-8a6e-46d1-aff3-2b85551df7db None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.039674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.040457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.040830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-10b804c3-8a6e-46d1-aff3-2b85551df7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:05.040997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:05.043113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:05.045879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:05.045879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:05.045879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:05.046505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.046793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 403/778] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:05.047042 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:05.047042 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.047483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09abfb-8d7c-4c45-82ef-37357c6ca5db None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.047483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09abfb-8d7c-4c45-82ef-37357c6ca5db None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.047483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09abfb-8d7c-4c45-82ef-37357c6ca5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.048105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.069314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 376/779] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:05.069314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.071027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ed09abfb-8d7c-4c45-82ef-37357c6ca5db None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:05.072639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ed09abfb-8d7c-4c45-82ef-37357c6ca5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:05.159579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 404/780] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:05.161783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09abfb-8d7c-4c45-82ef-37357c6ca5db None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.198761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009049-7f49-4299-aa06-2aec9ddfebb7 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.216750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.251747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.253062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.253841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.254555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.255938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] RBAC: Adding query filter params (type=network) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:05.256699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.259218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.268202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 377/781] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:05.269964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.353034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.359876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09abfb-8d7c-4c45-82ef-37357c6ca5db None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.423512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.424488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.424991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.425474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.427276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.429727 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:05.446610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:05.448611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:05.450228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 405/782] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:05.451838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.451966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39ddc0-ba4d-4364-bcf7-213cac9bd9de None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.514381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.515867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.516614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.517376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.518615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:05.519186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.522363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.548759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 378/783] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:05.548759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.614678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.624017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2017-0ae1-4fe5-a832-4cb1a7b7ee39 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.686333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.687483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.688017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.688522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.700401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa53ab5-189c-4ce2-ab92-0ca4a971cb8d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.701914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.704894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:05.725782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:05.727212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:05.728327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:05.729473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 406/784] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:05.730941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.739970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.740676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.741017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.741355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.742164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] RBAC: Adding query filter params (interface=public, service_id=14d1943a896b4c3ba1fbecda770ce091, region_id=RegionOne) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:05.742567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.744133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.756111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 379/785] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/endpoints?service_id=14d1943a896b4c3ba1fbecda770ce091&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:05.757644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.764697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.849765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898b947-624d-4996-af6b-a6d2979d08ac None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.903857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.907094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca7ce-257a-466c-81be-f6269feaf078 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.913693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.914771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.915295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.915785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.916926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:05.917492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.920125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.928998 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 407/786] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:05.933911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.947619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.948271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.948557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.948836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.957609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.959128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:05.971114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:05.972353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 380/787] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:05.975136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.058368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.074502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285b68a-52bf-4248-a2ad-3730adf94a36 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.111929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.112573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.112856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.113246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.125818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:06.130675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1954c8-875b-45ee-8490-1623d6b29523 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:06.132674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:06.134918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 408/788] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:06.136833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.181391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.182008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.182304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.182579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.183362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:06.183670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.185205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.199697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 381/789] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.200446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.225689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.278570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d07c2-3276-43a3-a073-cd7d2cd74840 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.323910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.324659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.325008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.325435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.326264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.328152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.334554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 409/790] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.335407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.351239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940dfa1-aecc-4614-a784-9a8268ea9c18 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.352056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.400840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.401664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.402113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.402551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.403580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:06.403950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.405757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.412662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 382/791] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.481736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6eef7-e695-4271-b81d-725ed648b628 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.538353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.539128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.539416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.539699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.540413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:06.540718 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.542175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.552039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.561121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 410/792] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.562337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.583041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279efd1-bd33-44fd-bf9a-a3099cf12319 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.644990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.646317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.646862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.647346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.648562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:06.649108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.651673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.668517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 383/793] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.670032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.706147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.759981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4680-abd0-4b85-b6fc-4336975bfc85 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.822096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.823205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.823644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.824011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/31e687163dec4063a3932d164b06654e/roles/6666a44189e7493d9de289fe534d6dff` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.850281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=31e687163dec4063a3932d164b06654e, role_id=6666a44189e7493d9de289fe534d6dff)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.851256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763facf9-3631-4811-b27a-68fdeac3e207 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.852807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.897646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.898276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.898562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.898920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.899643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] RBAC: Adding query filter params (interface=public, service_id=7d995989b17747b699673e2a560bad90, region_id=RegionOne) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:06.899958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.901368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.907667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 384/794] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/endpoints?service_id=7d995989b17747b699673e2a560bad90&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.908732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.934666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 411/795] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:06 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/31e687163dec4063a3932d164b06654e/roles/6666a44189e7493d9de289fe534d6dff => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:06.934666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.940685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.108026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc96b-cf0f-4f7e-8053-dfd683f2dac6 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.114048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d8c55-0122-4532-bd9d-63aa9ef3c6c1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.153742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.178984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.179655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.179931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.180209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.186301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.187510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.188031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.189678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/a78694291dba47f1b833c721cb728460/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.195363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.196822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=a78694291dba47f1b833c721cb728460, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.197016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.201147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:07.215583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:07.219842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:07.220723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:07.220723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:07.220723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:07.221493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 412/796] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:07.222917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.299457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 385/797] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:06 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/a78694291dba47f1b833c721cb728460/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:07.301537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.477692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d939-9f6b-49ec-baa4-a82136aac92e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.487023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.525139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2815a-82d5-4038-8365-9d7e9c17c823 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.552523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.553577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.554080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.554783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.555783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.558596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.568312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.569223 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.569765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.570201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.571107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:07.571576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.571796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 413/798] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/services => generated 772 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:07.573575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.589996 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 386/799] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:07.597324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.675537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.852682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e89435-5dfa-4340-b68a-0eb26d2a3f4a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.931497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.933036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.933777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.934493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.955596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.958870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:07.993617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:07.995446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:07.997272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:08.001935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 414/800] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:08.011918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.258691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e66ee-e359-46b8-b2a9-8f11ea3ee55d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.328018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:08.340253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6177-5acc-4642-bd67-65046fb118a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.341302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6177-5acc-4642-bd67-65046fb118a0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.341801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6177-5acc-4642-bd67-65046fb118a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.342301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6177-5acc-4642-bd67-65046fb118a0 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.343804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6177-5acc-4642-bd67-65046fb118a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:08.348083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6177-5acc-4642-bd67-65046fb118a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:08.348083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6177-5acc-4642-bd67-65046fb118a0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:08.397193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 387/801] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:08.406728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.602894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:08.613688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cc3e-eeff-4bf6-9388-f881dbed0fd1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.654211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.654901 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.655187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.655465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.668752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:08.670239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:08.687927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f328a-177d-4d0a-8142-270af8604aed None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.688355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f328a-177d-4d0a-8142-270af8604aed None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.688733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f328a-177d-4d0a-8142-270af8604aed None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.690422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 388/802] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:08.691823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:08.693044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:08.693898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:08.693898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:08.693898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:08.694293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 415/803] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:08.697434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d021-1609-4799-96bf-59cb2686ac0f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.697820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d021-1609-4799-96bf-59cb2686ac0f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.698169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d021-1609-4799-96bf-59cb2686ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.704014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.728191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e538d021-1609-4799-96bf-59cb2686ac0f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:08.729461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e538d021-1609-4799-96bf-59cb2686ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:08.862451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 389/804] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:08.893522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3981-5b5f-4915-bec5-997380b5def5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.954583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.955238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.955525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.955805 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.956465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:08.956826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:08.958225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:08.980374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 416/805] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:08.989615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d021-1609-4799-96bf-59cb2686ac0f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.105471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d021-1609-4799-96bf-59cb2686ac0f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.125561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.145709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.146370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.146674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.146962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.155047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.157569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:09.170945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:09.171910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:09.173214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 390/806] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:09.181915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.199471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.310567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b9deb-77a7-4a75-901c-81ae88a99f85 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.359173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.359808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.360095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.360378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.361109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:09.361425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.363714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.386969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 417/807] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:09.393704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.406715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.520027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648191-0f45-4cbf-9d68-ec74cbc74d67 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.538128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8b45a-f6c6-482e-8e20-ae953255ad99 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.560514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fc056-111b-40e7-88d2-ade8e9250545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.561200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc056-111b-40e7-88d2-ade8e9250545 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.561486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc056-111b-40e7-88d2-ade8e9250545 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.561766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc056-111b-40e7-88d2-ade8e9250545 None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/fc0c376af51e4b5195da5ff453026ec9/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.563850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fc056-111b-40e7-88d2-ade8e9250545 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=fc0c376af51e4b5195da5ff453026ec9, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.565406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fc056-111b-40e7-88d2-ade8e9250545 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.568563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.582416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5d09-972c-4c33-a4cb-36fdfff8fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.594158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5d09-972c-4c33-a4cb-36fdfff8fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.594158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5d09-972c-4c33-a4cb-36fdfff8fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.594158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5d09-972c-4c33-a4cb-36fdfff8fbc5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.594158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a5d09-972c-4c33-a4cb-36fdfff8fbc5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.594158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a5d09-972c-4c33-a4cb-36fdfff8fbc5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b01a5d09-972c-4c33-a4cb-36fdfff8fbc5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:09.595445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:09.596478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:09.597341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:09.598700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 418/808] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:09.600356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56351b2-3ef4-4f08-a7e3-293a5a0da9f2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.600896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56351b2-3ef4-4f08-a7e3-293a5a0da9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.601380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56351b2-3ef4-4f08-a7e3-293a5a0da9f2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.603812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 419/809] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:09.605439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56351b2-3ef4-4f08-a7e3-293a5a0da9f2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.656251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 391/810] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:09 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/fc0c376af51e4b5195da5ff453026ec9/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:09.658344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3759-6069-41c8-a2dc-9719721f6c18 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.658925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3759-6069-41c8-a2dc-9719721f6c18 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.659418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3759-6069-41c8-a2dc-9719721f6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.693722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ebbc3759-6069-41c8-a2dc-9719721f6c18 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:09.700444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ebbc3759-6069-41c8-a2dc-9719721f6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:09.742660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56351b2-3ef4-4f08-a7e3-293a5a0da9f2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.760869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.812104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 392/811] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:09.835732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.860181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.861261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.861839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.862336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.864149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:09.864694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.867400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.883178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 420/812] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:09.887245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dddb9-7cbf-481c-8c31-ace5daa87855 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.887545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dddb9-7cbf-481c-8c31-ace5daa87855 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.887808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dddb9-7cbf-481c-8c31-ace5daa87855 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.889625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 393/813] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:09.893694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.895684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15a88-16ac-418b-bf23-1ad9609d82d5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.895969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15a88-16ac-418b-bf23-1ad9609d82d5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.896243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15a88-16ac-418b-bf23-1ad9609d82d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.921266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5fb15a88-16ac-418b-bf23-1ad9609d82d5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:09.921800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5fb15a88-16ac-418b-bf23-1ad9609d82d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:10.028441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 394/814] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:10.062742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa8e1-5e69-4293-b2dc-85128d6a7fc6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.108095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.108722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.109001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.109270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.109914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:10.110218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:10.111616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.124806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 421/815] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:10.131503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15a88-16ac-418b-bf23-1ad9609d82d5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.251930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.444830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.451131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.465762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15a88-16ac-418b-bf23-1ad9609d82d5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.580937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.582525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.585429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.586245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.588866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:10.596531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.607838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b176df6-4f27-456d-b229-faf09de8f6e8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.678728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.681667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.682144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.682694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.704413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:10.715598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:10.717514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:10.719207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 422/816] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:10.722134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.734548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 395/817] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 604 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:01:10.736540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.943007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8d5d7-1c4e-4ef8-84a1-f8f762f66f86 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.969425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.999122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.000139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.000631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.001113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.016695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:11.024382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:11.025342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:11.026170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:11.029179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 423/818] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:11.034221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8f95f-cafb-4d75-8888-8bcd10cc008e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.039468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.109965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.111088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.111596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.112084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.113429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:11.113960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.116758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.142657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 396/819] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:11.145297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.184967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.344735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c8e75-fc11-44b3-a903-f2700a8265bc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.348823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb496-5614-4880-8140-7e7c3df9ff98 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.391433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee59c-0c36-4ebb-b264-4442eb82cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.391672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cbe44-9191-4b31-8729-3febe18e4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.392208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbe44-9191-4b31-8729-3febe18e4dbc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.392430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee59c-0c36-4ebb-b264-4442eb82cc57 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.392531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbe44-9191-4b31-8729-3febe18e4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.392756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbe44-9191-4b31-8729-3febe18e4dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.392916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee59c-0c36-4ebb-b264-4442eb82cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.393326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee59c-0c36-4ebb-b264-4442eb82cc57 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.395077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee59c-0c36-4ebb-b264-4442eb82cc57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:11.395575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee59c-0c36-4ebb-b264-4442eb82cc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.397877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee59c-0c36-4ebb-b264-4442eb82cc57 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.407436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cbe44-9191-4b31-8729-3febe18e4dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.409394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cbe44-9191-4b31-8729-3febe18e4dbc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.411399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 424/820] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:11.413637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef446-b964-410c-88f8-228b567e29d5 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.414073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef446-b964-410c-88f8-228b567e29d5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.414501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef446-b964-410c-88f8-228b567e29d5 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.416979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 425/821] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:11.418567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef446-b964-410c-88f8-228b567e29d5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-602cbe44-9191-4b31-8729-3febe18e4dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:11.432667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:11.433704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:11.434819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:11.434819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:11.434819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:11.441702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 397/822] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:11.443623 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db175-a807-4e01-9fc1-323b408d0b98 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.444069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db175-a807-4e01-9fc1-323b408d0b98 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.444488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db175-a807-4e01-9fc1-323b408d0b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.472619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7f2db175-a807-4e01-9fc1-323b408d0b98 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:11.474594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7f2db175-a807-4e01-9fc1-323b408d0b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:11.480717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.555263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.565606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 398/823] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:11.568454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db175-a807-4e01-9fc1-323b408d0b98 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.568984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef446-b964-410c-88f8-228b567e29d5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.649153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.651395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.652110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.652898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.686689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.688695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:11.719715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:11.720719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:11.721582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:11.721582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:11.721582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:11.722178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 426/824] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:11.732753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.756323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db175-a807-4e01-9fc1-323b408d0b98 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.816964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.818062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.818511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.819020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.820222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:11.820751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.823410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.854489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 399/825] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:11.856943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.947401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.951109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.963781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae738a5-1c91-4334-9568-b4084f8e233b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.020214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.021400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.021867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.022744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.023973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:12.024477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.026108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.026891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4195f-5368-426f-aaa0-09f6151037d2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.045839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 427/826] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:12.047580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.090955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.091920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.092195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.092475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.102397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.103893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:12.119807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:12.120786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:12.121703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:12.127738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 400/827] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:12.127738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.233545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70a4ca-11e3-4ab9-9a07-ee5c6afa4111 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.272273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28e487-2ea5-4b5f-a6a4-3fbd0df46db3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.286697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.287714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.287996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.288271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.288866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.290237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.299244 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:12.299708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:12.307846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:12.308754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 428/828] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:12.309600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.324822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.334386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.335124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.335358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.335628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.343586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.345034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:12.358071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:12.362571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 401/829] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:12.366190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.480395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedc9ff-36a6-4941-8172-4b58068f972b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.523704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.524415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.524781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.525186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.526081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:12.526578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.528680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.533292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721e6d-67bb-4500-bf6e-bd08bcf67d36 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.551509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 429/830] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:12.552386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.586453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5363dcc-9fdd-4ab8-acaf-b7ddf0cb1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.587311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363dcc-9fdd-4ab8-acaf-b7ddf0cb1e85 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.587708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363dcc-9fdd-4ab8-acaf-b7ddf0cb1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.588095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363dcc-9fdd-4ab8-acaf-b7ddf0cb1e85 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.588922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5363dcc-9fdd-4ab8-acaf-b7ddf0cb1e85 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:12.589346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5363dcc-9fdd-4ab8-acaf-b7ddf0cb1e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.590996 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5363dcc-9fdd-4ab8-acaf-b7ddf0cb1e85 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.602201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 402/831] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:12.602201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b56f0-12c8-46e3-9a82-6229a309bd4f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.602201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b56f0-12c8-46e3-9a82-6229a309bd4f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.602201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b56f0-12c8-46e3-9a82-6229a309bd4f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.602201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 403/832] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:12.602729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b56f0-12c8-46e3-9a82-6229a309bd4f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.657257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.661380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.694106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472677-a4a5-4286-98ff-ce63149a912b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.737407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b56f0-12c8-46e3-9a82-6229a309bd4f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.741837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.742869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.743338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.743813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.745164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:12.745688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.748238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.779239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 430/833] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:12.780887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.786719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.787476 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.787817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.788253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.871793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.873284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.929078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.935172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7de83-726b-4353-9617-6b5d8f0ac5d2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.974947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.981828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f6f13-fa2d-4510-9c07-24229c5f0902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.982394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f6f13-fa2d-4510-9c07-24229c5f0902 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.982717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f6f13-fa2d-4510-9c07-24229c5f0902 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.982976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f6f13-fa2d-4510-9c07-24229c5f0902 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.984179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f6f13-fa2d-4510-9c07-24229c5f0902 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:12.984179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f6f13-fa2d-4510-9c07-24229c5f0902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.989563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f6f13-fa2d-4510-9c07-24229c5f0902 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.999007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 431/834] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:12.999007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288ff7-9b88-4246-a82f-c116ab8ef33b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.999007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288ff7-9b88-4246-a82f-c116ab8ef33b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.999007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288ff7-9b88-4246-a82f-c116ab8ef33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.024223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f6288ff7-9b88-4246-a82f-c116ab8ef33b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:13.026303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f6288ff7-9b88-4246-a82f-c116ab8ef33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:13.028545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 404/835] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:13.029811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.122396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 432/836] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:13.123671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288ff7-9b88-4246-a82f-c116ab8ef33b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.163495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a332d33-ff56-48d6-956c-7b60fe20846f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.205487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.206128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.206407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.207246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.226190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.263466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288ff7-9b88-4246-a82f-c116ab8ef33b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.304247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.309469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.311898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.322195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.323193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.323641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.324087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.325204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.327900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.441448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 405/837] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:13.442662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.474698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 433/838] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:13.475460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.530680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.622498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f132d9-e3a9-4e11-9412-9ec86361e221 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.644753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae440ad-aba3-4f8c-be18-2cbf7f519ffd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.695571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.696587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.697039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.697436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.712952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.714442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.719041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.720189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.720697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.721188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:13.737143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:13.738991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:13.739877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:13.739877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:13.739877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:13.739877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 434/839] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:13.741091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.744558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.746434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:13.763631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:13.764624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:13.765474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:13.765474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:13.765474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:13.766384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 406/840] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:13.767959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.779644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.887749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.895665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28b9d3-9c04-4f4f-b1ca-be8c22a93e09 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.911529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d939-d634-4f9b-89c3-7d0c11a7cef2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.944911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.945955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.946523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.947038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.948161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:13.948699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.950415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.951094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.951279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.951381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.951641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.963319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:13.968751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:13.969700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:13.970563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:13.975050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 435/841] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:13.976045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.983245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 407/842] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:13.984777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.080870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.094900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a3b08-a9cd-4037-b07a-e0be5c357abc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.136178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.136435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6192ac5-0a3f-4023-8bc4-0c60561506ba None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.136799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.137076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.137347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.138054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:14.138306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.139743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.153732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 436/843] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:14.154390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.195006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.195617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.195894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.196180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.196850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:14.197155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.198548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.216345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 408/844] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:14.216345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.230954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.293006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12747d0-49c1-4889-8707-ab6904adc68a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.333525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.334184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.334470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.334779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.342576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.344097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.355946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a1f86-b98d-4a6e-a094-964a4ae2d470 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:14.358301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:14.359246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:14.360209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:14.365016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 437/845] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:14.365885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.378212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.405575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.406726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.407326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.407746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.420889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.423582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:14.446137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:14.447132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:14.448009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 409/846] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:14.449631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.499550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7da6-be07-40e2-86e5-b9c835c90c0e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.540985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.541910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.542197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.542476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.552082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.559010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.560976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.576679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a991fb-f3a6-4106-9b0f-f53fab6539bc None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:14.581204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:14.591475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:14.593224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:14.593224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:14.593224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:14.593224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 438/847] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:14.593224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.621703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.622698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.623161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.623616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.624826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:14.625341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.627719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.653268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 410/848] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:14.653268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.718530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.771180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bf411-bf4a-4842-ac94-4da80474f4cf None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.792061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f3554-c3ec-4dfd-8692-1e3876bd5479 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.811302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.811918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.812220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.812581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.813129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:14.813437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.814855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.817992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.837799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 411/849] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:14.837799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.848664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.849683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.850159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.850692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.852014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:14.852561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.855259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.870555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 439/850] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:14.871204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.970377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264635-d18f-4fd9-9a7c-450dbc08df10 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.009387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.010016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.010300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.010579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.011351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=a78694291dba47f1b833c721cb728460) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:15.011593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c1fb-9831-4bdb-8b81-80c5675ba0c4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.011694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.013091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.030821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 412/851] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/role_assignments?user.id=a78694291dba47f1b833c721cb728460&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:15.030821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.057401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.084192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.085959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.087019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.087844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.101945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.104699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:15.128429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:15.130093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:15.131725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:15.136006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 440/852] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:15.142431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.144440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.196677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81f18-59f5-418c-8e14-3a4cffccbd5a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.245495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.246164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.246845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.247235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.248097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=31e687163dec4063a3932d164b06654e) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:15.248515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.250849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.259282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 413/853] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/role_assignments?user.id=31e687163dec4063a3932d164b06654e&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:15.326440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bd6da-7f1e-454b-a2a6-7febdff06d14 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.388187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.389266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.389757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.390248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.391700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:15.392243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.395507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.442874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 441/854] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:15.445909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.656483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10208f7-8d57-4a61-88a2-04233016019e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.729094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.735158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb368a-04c5-416c-a9f0-0ef1635d5f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.736183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb368a-04c5-416c-a9f0-0ef1635d5f15 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.736674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb368a-04c5-416c-a9f0-0ef1635d5f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.737159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb368a-04c5-416c-a9f0-0ef1635d5f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.888527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb368a-04c5-416c-a9f0-0ef1635d5f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.891398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb368a-04c5-416c-a9f0-0ef1635d5f15 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.096584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 414/855] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:16.106156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.180313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:16.273150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982914d-4d45-40c6-bafd-4af435b96a74 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.346713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.349064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.349552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.350033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.370511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.373308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:16.408087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:16.410519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:16.413395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:16.413395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:16.413395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:16.413395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 442/856] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:16.418670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5550bc-d4ba-499e-b863-a2a794cfa136 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.418670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5550bc-d4ba-499e-b863-a2a794cfa136 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.418670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5550bc-d4ba-499e-b863-a2a794cfa136 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.418670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 415/857] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:16.421058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.426131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade7c9-0d52-4bbb-a669-39014a705d12 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.426481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade7c9-0d52-4bbb-a669-39014a705d12 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.426767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade7c9-0d52-4bbb-a669-39014a705d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.461467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e6ade7c9-0d52-4bbb-a669-39014a705d12 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:16.464551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e6ade7c9-0d52-4bbb-a669-39014a705d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:16.512826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:16.572741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:16.596158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8cde8-e8f5-41ae-a59c-3bafb8745a72 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.634744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 416/858] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:16.664909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.665778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.666234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.666682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.667477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:16.667945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.669457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.692290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 443/859] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:16.698216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ade7c9-0d52-4bbb-a669-39014a705d12 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.857386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ade7c9-0d52-4bbb-a669-39014a705d12 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.924668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.927168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.927671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.928163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.942819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.945602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:16.969116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:16.970049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:16.971054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:16.971748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 417/860] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:16.978502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.995571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.013244 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.115245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50267-16fa-4df8-ab99-1564fe09895c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.144843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e396-01a8-4a90-b85f-e5de098d76d8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.177999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.178942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.179057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.179413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.180257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.181931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.188194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.189093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.189558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.190047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.191414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.191964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.193649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:17.198499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:17.199597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:17.200439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:17.201172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 418/861] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:17.207811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.222815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 444/862] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:17.232747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.264598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.328316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.364385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527bc3-c017-46a1-9a58-3dcec3cc20fc None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.405451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.406116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.406675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.406675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.407395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.407731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.409180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.411247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58967a11-675c-42fb-9ce5-3575823299a3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.418967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 419/863] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:17.421615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.454237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31028759-010a-4bde-833f-4f017d06b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.454883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31028759-010a-4bde-833f-4f017d06b735 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.455171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31028759-010a-4bde-833f-4f017d06b735 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.455454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31028759-010a-4bde-833f-4f017d06b735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.456212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31028759-010a-4bde-833f-4f017d06b735 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=fc0c376af51e4b5195da5ff453026ec9) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.456557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31028759-010a-4bde-833f-4f017d06b735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.458167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31028759-010a-4bde-833f-4f017d06b735 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.470657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 445/864] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/role_assignments?user.id=fc0c376af51e4b5195da5ff453026ec9&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:17.561141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c14c-2e4c-43b3-8673-de124cce9dca None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.604345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f573414-c382-4a9f-b5d7-0d6cd994c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.605430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f573414-c382-4a9f-b5d7-0d6cd994c4ed None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.605947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f573414-c382-4a9f-b5d7-0d6cd994c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.606419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f573414-c382-4a9f-b5d7-0d6cd994c4ed None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.607372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f573414-c382-4a9f-b5d7-0d6cd994c4ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.607908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f573414-c382-4a9f-b5d7-0d6cd994c4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.609598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f573414-c382-4a9f-b5d7-0d6cd994c4ed None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.616704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 420/865] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:18.138474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550ea30-2574-4240-a1b2-140eb37848ac None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.138878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550ea30-2574-4240-a1b2-140eb37848ac None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.139113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550ea30-2574-4240-a1b2-140eb37848ac None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.140752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 446/866] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:18.150752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec49dcd-b553-4b1e-acca-10bd8000c230 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.150752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec49dcd-b553-4b1e-acca-10bd8000c230 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.150752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec49dcd-b553-4b1e-acca-10bd8000c230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.174581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:18.183464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5ec49dcd-b553-4b1e-acca-10bd8000c230 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:18.194184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5ec49dcd-b553-4b1e-acca-10bd8000c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:18.315525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 421/867] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:18.512311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382faec5-ae6a-4c51-b9be-ab68c79eb27c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.513074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382faec5-ae6a-4c51-b9be-ab68c79eb27c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.513074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382faec5-ae6a-4c51-b9be-ab68c79eb27c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.514503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 447/868] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:18.521752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6b45-8bee-4c56-9f72-3c87ed547d73 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.522730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6b45-8bee-4c56-9f72-3c87ed547d73 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.523511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6b45-8bee-4c56-9f72-3c87ed547d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.556957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-654f6b45-8bee-4c56-9f72-3c87ed547d73 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:18.559650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-654f6b45-8bee-4c56-9f72-3c87ed547d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:18.593246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382faec5-ae6a-4c51-b9be-ab68c79eb27c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.683544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 422/869] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:18.757085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:18.791056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382faec5-ae6a-4c51-b9be-ab68c79eb27c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.829884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.830529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.830846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.831124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.843145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:18.849500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:18.851273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:18.852885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 448/870] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:18.857727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6b45-8bee-4c56-9f72-3c87ed547d73 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.936644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:18.959625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.983072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6b45-8bee-4c56-9f72-3c87ed547d73 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.025438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.026077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.026364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.026656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.027357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:19.027665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.029338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.040082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 423/871] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:19.048234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.102998 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b507bb1-acb0-458b-b0c4-54c5ed0b5ad3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.142013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.142812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.143166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.143514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.145352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.146881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.149071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:19.157890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:19.166688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:19.168770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 449/872] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:19.173308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.184142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbdb32-3987-4f25-ada1-39247f5f661d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.220777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.231578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.232330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.232673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.233014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.248985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.251054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:19.271855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:19.274279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:19.276369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:19.276369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:19.276369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:19.278678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 424/873] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:19.280259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.293224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f5509-508d-40b4-b73d-e32b074200c7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.335431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.336516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.337024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.337580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.338590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:19.339127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.340867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.352367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 450/874] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:19.353872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.417761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddf471-3dba-4d32-a968-4cd40c48f2ed None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.439709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.460357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.461576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.462093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.462567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.463461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:19.463976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.465647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.482856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 425/875] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:19.487653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.502977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5351e6-e265-48c6-92f1-ea3d9fc9bf23 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.538283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.579821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.582918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.583869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.584755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.586377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:19.587427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.590452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.605896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5385-1269-4654-8b06-0d8cd9df5963 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.607261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 451/876] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:19.648712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120c389-c5f8-4524-bbfd-1ecd40b7ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.649378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c389-c5f8-4524-bbfd-1ecd40b7ae16 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.649663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c389-c5f8-4524-bbfd-1ecd40b7ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.649934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c389-c5f8-4524-bbfd-1ecd40b7ae16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.658966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120c389-c5f8-4524-bbfd-1ecd40b7ae16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.661294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120c389-c5f8-4524-bbfd-1ecd40b7ae16 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-d120c389-c5f8-4524-bbfd-1ecd40b7ae16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:19.675938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:19.677825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:19.680269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 426/877] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:19.684794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.718197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211db9-735b-4008-bb0a-ec143e9e480b None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.718807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211db9-735b-4008-bb0a-ec143e9e480b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.719187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211db9-735b-4008-bb0a-ec143e9e480b None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.729806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 427/878] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:19.732636 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f60d-7907-4cc9-99ab-28e16b89d924 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.733118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f60d-7907-4cc9-99ab-28e16b89d924 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.733584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f60d-7907-4cc9-99ab-28e16b89d924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.770948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ec95f60d-7907-4cc9-99ab-28e16b89d924 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:19.773068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ec95f60d-7907-4cc9-99ab-28e16b89d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:19.891976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 428/879] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:19.922558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb3f6-e5b8-44c2-8583-1ac8e44ff502 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.976826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.993533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e56c85-3caa-402f-a07f-4a99ac686ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.994612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56c85-3caa-402f-a07f-4a99ac686ccf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.995155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56c85-3caa-402f-a07f-4a99ac686ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.995649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56c85-3caa-402f-a07f-4a99ac686ccf None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.997090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e56c85-3caa-402f-a07f-4a99ac686ccf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:19.997678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e56c85-3caa-402f-a07f-4a99ac686ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.000646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e56c85-3caa-402f-a07f-4a99ac686ccf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.039449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 452/880] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:20.048606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f60d-7907-4cc9-99ab-28e16b89d924 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.092897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5b97-4673-4b7f-8c10-f4a8fd675fb9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.093251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5b97-4673-4b7f-8c10-f4a8fd675fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.093459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5b97-4673-4b7f-8c10-f4a8fd675fb9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.094867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 453/881] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:20.101219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571149-1537-47d9-8f58-652eb165439c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.101692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571149-1537-47d9-8f58-652eb165439c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.102072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571149-1537-47d9-8f58-652eb165439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.109522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:20.137296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1b571149-1537-47d9-8f58-652eb165439c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:20.140485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1b571149-1537-47d9-8f58-652eb165439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:20.250894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 454/882] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:20.253640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f60d-7907-4cc9-99ab-28e16b89d924 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.257603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571149-1537-47d9-8f58-652eb165439c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.322279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.323343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.323851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.324351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.449768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571149-1537-47d9-8f58-652eb165439c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.466192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.469060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.483961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:20.529628 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.531409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.531914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.532420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.533580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.536337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.541362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:20.555061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:20.557283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:20.559123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:20.561622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 455/883] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:20.562495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.692127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 429/884] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:20.693745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.758756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ebfa8-4c8e-4eb9-98ff-6367b9290ff1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.801123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.801955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.802235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.802511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.803229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.804640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.861984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51f255-63b0-4670-969b-60cddb5988b3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.894572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:20.900503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.901181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.901475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.901758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.902401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:20.902749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.904453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.909382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 430/885] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:20.910548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.926763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 456/886] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:20 2022] POST /identity/v3/services => generated 251 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:20.926763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.030130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.059801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90df23-4006-4e2d-9a60-e2ca254fb636 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.138416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.139160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.139455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.139992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.153926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.155512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:21.174664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:21.176642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:21.178911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:21.178911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:21.178911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:21.178911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 431/887] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:21.185140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1062476-984a-49d5-b1ca-a139750c3d44 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.185527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.246704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.247564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.248272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.248556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.248968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.249533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:21.249860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.251301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.256669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 457/888] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:21.367788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5bb80-11b9-49b5-ad11-d2ef268afccc None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.436747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.437716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.438164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.438598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.439671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:21.440133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.443069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.464765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 432/889] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:21.471242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.644905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c0ae-77f3-428b-9efa-e036113d8684 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.648429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.707062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.708107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.708399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.708664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.716370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.717828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:21.730861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:21.732471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:21.733436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 458/890] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:21.739628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.928542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1a69-646d-40f4-addf-4d53c0b4b4dd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.931295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.998604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1eb44-063e-48d2-aafe-2073d3244adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.999702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1eb44-063e-48d2-aafe-2073d3244adb None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.000203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1eb44-063e-48d2-aafe-2073d3244adb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.000699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1eb44-063e-48d2-aafe-2073d3244adb None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.002028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1eb44-063e-48d2-aafe-2073d3244adb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:22.002589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1eb44-063e-48d2-aafe-2073d3244adb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.005419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1eb44-063e-48d2-aafe-2073d3244adb None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.028346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 433/891] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:22.034112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.147912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3236-85ea-47f3-a685-51f779508ed4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.185762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b18fe-a430-4ff4-81a1-a04383820df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.186758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b18fe-a430-4ff4-81a1-a04383820df4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.187256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b18fe-a430-4ff4-81a1-a04383820df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.187734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b18fe-a430-4ff4-81a1-a04383820df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.188679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b18fe-a430-4ff4-81a1-a04383820df4 None admin] RBAC: Adding query filter params (role.id=c85ea3ef4c554385b91a4692fc8b791a, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=31e687163dec4063a3932d164b06654e) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:22.189239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b18fe-a430-4ff4-81a1-a04383820df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.191515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b18fe-a430-4ff4-81a1-a04383820df4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.198524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 459/892] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:22 2022] GET /identity/v3/role_assignments?user.id=31e687163dec4063a3932d164b06654e&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=c85ea3ef4c554385b91a4692fc8b791a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:22.353913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b53b7-3cbc-4081-a745-cb8c71396ad4 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.354427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b53b7-3cbc-4081-a745-cb8c71396ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.354989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b53b7-3cbc-4081-a745-cb8c71396ad4 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.357766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 434/893] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:22.367832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba781d3-2291-4d0d-9377-e3b3cd02feab None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.368334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba781d3-2291-4d0d-9377-e3b3cd02feab None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.368804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba781d3-2291-4d0d-9377-e3b3cd02feab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.400328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6ba781d3-2291-4d0d-9377-e3b3cd02feab None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:22.402455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6ba781d3-2291-4d0d-9377-e3b3cd02feab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:22.442484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:22.533268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 460/894] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:23.063415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b53b7-3cbc-4081-a745-cb8c71396ad4 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.188430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276753c-a4a3-4c1d-ad67-6d16a46f040d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.189427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276753c-a4a3-4c1d-ad67-6d16a46f040d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.189937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276753c-a4a3-4c1d-ad67-6d16a46f040d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.192441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 461/895] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:23.198309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421be6-6cf3-4399-9904-4589b56852c7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.198949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421be6-6cf3-4399-9904-4589b56852c7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.199474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421be6-6cf3-4399-9904-4589b56852c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.219512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-db421be6-6cf3-4399-9904-4589b56852c7 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:23.221413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-db421be6-6cf3-4399-9904-4589b56852c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:23.230877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b53b7-3cbc-4081-a745-cb8c71396ad4 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:23.269025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e9571-87b3-4d95-b845-8f6044ac718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:23.269657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e9571-87b3-4d95-b845-8f6044ac718d None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.269941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e9571-87b3-4d95-b845-8f6044ac718d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.270219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e9571-87b3-4d95-b845-8f6044ac718d None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.270984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e9571-87b3-4d95-b845-8f6044ac718d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:23.272378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e9571-87b3-4d95-b845-8f6044ac718d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:23.301532 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 462/896] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:23.386314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 435/897] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:23 2022] POST /identity/v3/services => generated 269 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:23.590180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421be6-6cf3-4399-9904-4589b56852c7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.732794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1145b3-78f3-45c9-8ab5-a91182a2fe9b None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.733142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1145b3-78f3-45c9-8ab5-a91182a2fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.733363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1145b3-78f3-45c9-8ab5-a91182a2fe9b None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.736158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 436/898] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:23.741372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0e79-20cb-423e-8d76-aedcf7d21218 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.741679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0e79-20cb-423e-8d76-aedcf7d21218 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.741935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0e79-20cb-423e-8d76-aedcf7d21218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.764531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a80e0e79-20cb-423e-8d76-aedcf7d21218 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:23.765753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a80e0e79-20cb-423e-8d76-aedcf7d21218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:23.783298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:23.793851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:23.802705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421be6-6cf3-4399-9904-4589b56852c7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:23.852276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:23.852930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.853211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.853524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.855143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:23.858174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:23.882545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:23.884602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:23.886206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 463/899] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:23.891708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.914806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 437/900] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:24.102510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e919483-7c7f-4add-9fce-d7ece4132b60 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.168629 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068099e6-9c4d-4398-ab19-5c3e358561ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.169672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068099e6-9c4d-4398-ab19-5c3e358561ab None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.170170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068099e6-9c4d-4398-ab19-5c3e358561ab None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.170684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068099e6-9c4d-4398-ab19-5c3e358561ab None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.171827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068099e6-9c4d-4398-ab19-5c3e358561ab None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:24.172380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068099e6-9c4d-4398-ab19-5c3e358561ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.175723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068099e6-9c4d-4398-ab19-5c3e358561ab None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.185255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 464/901] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:24.191422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e0e79-20cb-423e-8d76-aedcf7d21218 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:24.350678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbb47-ccfb-48de-9b7a-bf84d037c6ca None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.351229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbb47-ccfb-48de-9b7a-bf84d037c6ca None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.351875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbb47-ccfb-48de-9b7a-bf84d037c6ca None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.355329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 465/902] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:24.364951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1e2e-887d-4594-847d-55702b2874f1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.365280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1e2e-887d-4594-847d-55702b2874f1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.365511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1e2e-887d-4594-847d-55702b2874f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.384832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e0e79-20cb-423e-8d76-aedcf7d21218 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.387106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-09fa1e2e-887d-4594-847d-55702b2874f1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:24.388551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-09fa1e2e-887d-4594-847d-55702b2874f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:24.392926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:24.434453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.436621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.436900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.437178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.437808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:24.438123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.439553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.446759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 438/903] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:24.448810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:24.474195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:24.519161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 466/904] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:24.520328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa1e2e-887d-4594-847d-55702b2874f1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:24.608155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87432-4eb5-4a9e-9da8-43323d75d11f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.703574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.703574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.703574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.703574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.704897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.704897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.720882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa1e2e-887d-4594-847d-55702b2874f1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.781115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.781793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.782081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.782359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.783181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] RBAC: Adding query filter params (interface=public, service_id=0e2e51f6e41346b180cfa1031168f03b, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:24.783501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.787339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.790119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 439/905] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:24 2022] POST /identity/v3/services => generated 241 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:24.806864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 467/906] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:24 2022] GET /identity/v3/endpoints?service_id=0e2e51f6e41346b180cfa1031168f03b&interface=public®ion_id=RegionOne => generated 194 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:24.816992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:24.980925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.041404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40312-d813-42e4-a750-323e2bf92704 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.051223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.059107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.115645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.116790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.117205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.117687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.118819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:25.121432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:25.134330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 440/907] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:24 2022] GET /identity/v3/services => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:25.258400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817b1eb-db26-4139-8fd0-31ae9ae28b02 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.298732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98006283-499a-4758-822f-faa719d88be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.299443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006283-499a-4758-822f-faa719d88be1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.299726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006283-499a-4758-822f-faa719d88be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.300599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006283-499a-4758-822f-faa719d88be1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.313780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98006283-499a-4758-822f-faa719d88be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-98006283-499a-4758-822f-faa719d88be1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:25.319329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:25.321194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:25.322906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 468/908] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:25.330553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.475915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16db11-cb89-4cc4-8f05-130dd5f89381 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.516838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.517369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.517651 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.517927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.518670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:25.519010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:25.520411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:25.523352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.532086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 441/909] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:25.541667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98006283-499a-4758-822f-faa719d88be1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.655562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.707167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98006283-499a-4758-822f-faa719d88be1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.759716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd3be4-6dd8-4347-ab53-a5a47c3d5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.760891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd3be4-6dd8-4347-ab53-a5a47c3d5c21 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.761402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd3be4-6dd8-4347-ab53-a5a47c3d5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.761815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd3be4-6dd8-4347-ab53-a5a47c3d5c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.781825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd3be4-6dd8-4347-ab53-a5a47c3d5c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:25.783462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd3be4-6dd8-4347-ab53-a5a47c3d5c21 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-89cd3be4-6dd8-4347-ab53-a5a47c3d5c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:25.799754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:25.803854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:25.807343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:25.807343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:25.807343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:25.807343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 469/910] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:25.810761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.909045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db92ee-daed-4103-be70-f4c592b45e84 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.910345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db92ee-daed-4103-be70-f4c592b45e84 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.911102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db92ee-daed-4103-be70-f4c592b45e84 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.913157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 470/911] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:25.921064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b4da-bb90-435d-a5c6-2926b1bdf4d0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.921700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b4da-bb90-435d-a5c6-2926b1bdf4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.922043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b4da-bb90-435d-a5c6-2926b1bdf4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.940409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fcb5-0637-4068-a4d6-fc147f554c5b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.943198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a402b4da-bb90-435d-a5c6-2926b1bdf4d0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:25.947056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a402b4da-bb90-435d-a5c6-2926b1bdf4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:26.010033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.011320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.011908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.012465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.013730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:26.014698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.017176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.051137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 471/913] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:26.054715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 442/913] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:26.058444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402b4da-bb90-435d-a5c6-2926b1bdf4d0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.113870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.205153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402b4da-bb90-435d-a5c6-2926b1bdf4d0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.267370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.269569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.270378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.271207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.285392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.288650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:26.316975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:26.318057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:26.319136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:26.322074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 472/914] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:26.332306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.332874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.427992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.489331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369bb14-d7fa-44a7-a418-2c45b1385ae6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.498812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.502445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b649b9-d4b1-4f9b-89bd-5e64eb5bfd39 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.545845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.548208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.548948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.549698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.551158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.553422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.554115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.554459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.554825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.555241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.555693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:26.556062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.557546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:26.574905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:26.576762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:26.578571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:26.580661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 443/915] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:26.584098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 473/916] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:26.586263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.594966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.722525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a37864-6b48-437f-8525-3decfb41ee80 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.741635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.761095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.761744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.762023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.762297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.774413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.777957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:26.794749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:26.796870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:26.798657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:26.798657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:26.798657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:26.801949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351691ec-1c32-43b7-87b5-aeccabb18c4e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.803246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 444/917] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:26.804358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.868065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317e894-404c-44dc-bfd6-4f00d61e7ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.868813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317e894-404c-44dc-bfd6-4f00d61e7ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.869020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317e894-404c-44dc-bfd6-4f00d61e7ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.869241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317e894-404c-44dc-bfd6-4f00d61e7ab5 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.869895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317e894-404c-44dc-bfd6-4f00d61e7ab5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:26.870210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317e894-404c-44dc-bfd6-4f00d61e7ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.871651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317e894-404c-44dc-bfd6-4f00d61e7ab5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.882334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 474/918] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:26.882334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552a9b-a46c-4f17-90cb-ec9fd38a7a3a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.882334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552a9b-a46c-4f17-90cb-ec9fd38a7a3a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.882334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552a9b-a46c-4f17-90cb-ec9fd38a7a3a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.882334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 475/919] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:26.886482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552a9b-a46c-4f17-90cb-ec9fd38a7a3a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.936962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.970265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fa19-a61f-4cae-a69c-4e272b931fbf None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.028072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262afa8b-6407-4c0d-9faa-2e706463397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.028850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afa8b-6407-4c0d-9faa-2e706463397e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.029182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afa8b-6407-4c0d-9faa-2e706463397e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.029537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afa8b-6407-4c0d-9faa-2e706463397e None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.030677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262afa8b-6407-4c0d-9faa-2e706463397e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:27.031114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262afa8b-6407-4c0d-9faa-2e706463397e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.033093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262afa8b-6407-4c0d-9faa-2e706463397e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.037561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552a9b-a46c-4f17-90cb-ec9fd38a7a3a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.055989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 445/920] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:27.058058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08cfe7-25d8-46bb-99dc-c8e21c33d1af None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.058525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08cfe7-25d8-46bb-99dc-c8e21c33d1af None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.059007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08cfe7-25d8-46bb-99dc-c8e21c33d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.091428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1d08cfe7-25d8-46bb-99dc-c8e21c33d1af None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:27.093607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1d08cfe7-25d8-46bb-99dc-c8e21c33d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:27.099792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.101148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.101572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.101991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.103036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:27.103504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.105789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.120849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 476/921] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:27.120849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.146056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.222689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 446/922] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:27.222689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08cfe7-25d8-46bb-99dc-c8e21c33d1af None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.291393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.296365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040500-0d7d-454e-a372-d6089f0c448a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.343720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.344697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.345155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.345596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.354978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.356900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:27.371687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:27.372871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:27.373957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:27.376236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 477/923] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:27.386787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.423130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08cfe7-25d8-46bb-99dc-c8e21c33d1af None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.500075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.501357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.501945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.502506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.504278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] RBAC: Adding query filter params (interface=public, service_id=075925e99daa459395d7d75431b51f1c, region_id=RegionOne) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:27.504915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.507646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.523175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 447/924] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/endpoints?service_id=075925e99daa459395d7d75431b51f1c&interface=public®ion_id=RegionOne => generated 194 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:27.527586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.564751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.604456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fff8-51cc-4d95-b93f-77019b29df53 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.655205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab90268-66c2-4c5d-adfd-595bf2a09f80 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.665916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f89095-044e-45da-9830-b24de9062a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.667003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f89095-044e-45da-9830-b24de9062a84 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.667393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f89095-044e-45da-9830-b24de9062a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.667774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f89095-044e-45da-9830-b24de9062a84 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.669098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f89095-044e-45da-9830-b24de9062a84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:27.673666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f89095-044e-45da-9830-b24de9062a84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.673666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f89095-044e-45da-9830-b24de9062a84 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.696152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 478/925] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:27.698467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dba3-15ac-44c8-98c8-fa425f85e1f9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.698996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dba3-15ac-44c8-98c8-fa425f85e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.699496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dba3-15ac-44c8-98c8-fa425f85e1f9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.702081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 479/926] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:27.703330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58dba3-15ac-44c8-98c8-fa425f85e1f9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.703655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.704686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.705167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.705645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.706848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.710560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.717209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 448/927] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:27.718014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.735659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.861309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58dba3-15ac-44c8-98c8-fa425f85e1f9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.887464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.913968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9350fd4-dd52-4e9a-be45-b940a5ffe496 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.930434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637bace-7118-490c-9488-57990029da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.931570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637bace-7118-490c-9488-57990029da32 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.932096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637bace-7118-490c-9488-57990029da32 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.932668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637bace-7118-490c-9488-57990029da32 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.933723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637bace-7118-490c-9488-57990029da32 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.936279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637bace-7118-490c-9488-57990029da32 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.952513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.953245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.953528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.953800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/31e687163dec4063a3932d164b06654e/roles/c85ea3ef4c554385b91a4692fc8b791a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9637bace-7118-490c-9488-57990029da32 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:27.954362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:27.955334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:27.956235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:27.957452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 480/928] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:27.959335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97b99-3167-4d56-af94-ea4860e145bb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.959828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97b99-3167-4d56-af94-ea4860e145bb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.960310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97b99-3167-4d56-af94-ea4860e145bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.963608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=31e687163dec4063a3932d164b06654e, role_id=c85ea3ef4c554385b91a4692fc8b791a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.965062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.990195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9ad97b99-3167-4d56-af94-ea4860e145bb None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:27.992268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ad97b99-3167-4d56-af94-ea4860e145bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:28.050671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 449/929] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:27 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/31e687163dec4063a3932d164b06654e/roles/c85ea3ef4c554385b91a4692fc8b791a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:28.050671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.138874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 481/930] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:28.262433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8135b-fb51-4055-b7a1-6b28627e9095 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.334154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.339634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.340085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.340546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.341665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.342196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.344983 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.355338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 450/931] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:28.363828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad97b99-3167-4d56-af94-ea4860e145bb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.405155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.514555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.538932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.555311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad97b99-3167-4d56-af94-ea4860e145bb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.594835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.595455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.595736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.596011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.596694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.597023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.598830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.604972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 482/932] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:28.620609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.719988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d143c1-bd9f-4b9f-8e77-f93b06119b2a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.785288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.795990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.797196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.797800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.810325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.810325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.810325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:28.823536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:28.825556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:28.827732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 451/933] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:28.832439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.839081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de8b9f-1457-4c11-9d16-0d476eadd71d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.909245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.911689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.912441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.913176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.914960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] RBAC: Adding query filter params (interface=public, service_id=cee2e7daf31748b6af31f702f8ba29c0, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.915803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.918877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.929526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 483/934] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/endpoints?service_id=cee2e7daf31748b6af31f702f8ba29c0&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:28.937439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.949325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.998564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0a3c-3d72-4768-9b18-f1b6fb5098f7 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.058794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.060133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.060628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.061103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.061968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:29.062811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.065123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.072680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 452/935] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:29.079421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:29.098826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7e17c-dae1-4fba-8ec5-7c179054238d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.160001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.161013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.161533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.161908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.162658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.164153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.178953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 484/936] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/services => generated 1497 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:29.264368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ce472-c268-4266-9e45-95ba11de391c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.339411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baf486-d5ea-4c8b-a50a-a559513622b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.340508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf486-d5ea-4c8b-a50a-a559513622b5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.341010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf486-d5ea-4c8b-a50a-a559513622b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.341498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf486-d5ea-4c8b-a50a-a559513622b5 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.342781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf486-d5ea-4c8b-a50a-a559513622b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:29.343564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf486-d5ea-4c8b-a50a-a559513622b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.347721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf486-d5ea-4c8b-a50a-a559513622b5 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.356711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 453/937] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:29.362430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:29.370096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:29.487999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a5e34-1376-48eb-a3c9-2b4e20fb9e30 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.529806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e1d9f-8c9a-42dc-9d83-0008babdb8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.530432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1d9f-8c9a-42dc-9d83-0008babdb8dc None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.530749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1d9f-8c9a-42dc-9d83-0008babdb8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.531033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1d9f-8c9a-42dc-9d83-0008babdb8dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.531721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e1d9f-8c9a-42dc-9d83-0008babdb8dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.533106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e1d9f-8c9a-42dc-9d83-0008babdb8dc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.634969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 485/938] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:30.123585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc1e5-cb60-4381-809f-a7b6bf9a5de7 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.124123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc1e5-cb60-4381-809f-a7b6bf9a5de7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.124123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc1e5-cb60-4381-809f-a7b6bf9a5de7 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.125921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 454/939] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:30.132028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb62db2-b057-4bba-a6dc-c8e3b460747b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.132438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb62db2-b057-4bba-a6dc-c8e3b460747b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.132723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb62db2-b057-4bba-a6dc-c8e3b460747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.154912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bfb62db2-b057-4bba-a6dc-c8e3b460747b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:30.156160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bfb62db2-b057-4bba-a6dc-c8e3b460747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:30.233689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:30.261914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 486/940] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:30.551558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dc1e5-cb60-4381-809f-a7b6bf9a5de7 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:30.554563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:30.694890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dc1e5-cb60-4381-809f-a7b6bf9a5de7 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:30.739105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:30.739759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.740043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.740317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.740914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:30.742316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:30.752050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:30.753796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:30.755419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 455/941] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 17 20:01:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:30.763864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb62db2-b057-4bba-a6dc-c8e3b460747b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:30.960703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb62db2-b057-4bba-a6dc-c8e3b460747b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:31.005682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1c1f-c604-4ff6-b861-5f1cb303389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:31.006532 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1c1f-c604-4ff6-b861-5f1cb303389a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.006788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1c1f-c604-4ff6-b861-5f1cb303389a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.006943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1c1f-c604-4ff6-b861-5f1cb303389a None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.007638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa1c1f-c604-4ff6-b861-5f1cb303389a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:31.007949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa1c1f-c604-4ff6-b861-5f1cb303389a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:31.009399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa1c1f-c604-4ff6-b861-5f1cb303389a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:31.020353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 487/942] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:31.022330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:31.155995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:31.160271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515d32-cc52-4cec-ac7a-c3192bfae412 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.161087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515d32-cc52-4cec-ac7a-c3192bfae412 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.161586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515d32-cc52-4cec-ac7a-c3192bfae412 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.167582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 488/943] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:31.169795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2063-fa01-4d6c-9b2a-b18524c88979 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.175436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2063-fa01-4d6c-9b2a-b18524c88979 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.175436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2063-fa01-4d6c-9b2a-b18524c88979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.193128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f2ea2063-fa01-4d6c-9b2a-b18524c88979 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:31.194862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f2ea2063-fa01-4d6c-9b2a-b18524c88979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:31.212582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78d05-4568-4031-a3ef-cb630680f44b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:31.250920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:31.282654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 489/944] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:31.287139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:31.288194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.288728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.289237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.290339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:31.290907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:31.293589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:31.301745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 456/945] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:31.307887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2063-fa01-4d6c-9b2a-b18524c88979 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:31.492990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2063-fa01-4d6c-9b2a-b18524c88979 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:31.558930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6cd31-7efa-4926-a886-8f7d9fbdb36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:31.559966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6cd31-7efa-4926-a886-8f7d9fbdb36d None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.560452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6cd31-7efa-4926-a886-8f7d9fbdb36d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.560938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6cd31-7efa-4926-a886-8f7d9fbdb36d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.562149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6cd31-7efa-4926-a886-8f7d9fbdb36d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:31.564712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6cd31-7efa-4926-a886-8f7d9fbdb36d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:31.589264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:31.678661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 490/946] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:31.810499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf905a7b-25aa-48a2-875e-ee91c3c67863 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:31.817317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931124b-2d55-4070-82fb-69236d74cefc None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.817834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931124b-2d55-4070-82fb-69236d74cefc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.818270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931124b-2d55-4070-82fb-69236d74cefc None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.823039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 491/947] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:31.835695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca634-37d4-4cf2-8352-160eacd6bc40 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.836339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca634-37d4-4cf2-8352-160eacd6bc40 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.836924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bca634-37d4-4cf2-8352-160eacd6bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.852353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:31.866257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-34bca634-37d4-4cf2-8352-160eacd6bc40 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:31.868459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-34bca634-37d4-4cf2-8352-160eacd6bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:31.874004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:31.874668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.874977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.875249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.895316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:31.900241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:31.902097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:31.904706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 457/948] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:31.909718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:31.917945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:32.038661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 492/949] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:32.040814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1464-a8bc-498b-a231-f4daa23ddd88 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.046031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca7d5-3525-4b2f-8408-b8ec6324b398 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.046379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca7d5-3525-4b2f-8408-b8ec6324b398 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.046651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca7d5-3525-4b2f-8408-b8ec6324b398 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.048229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 493/950] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:32.054811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3773c-db08-4a20-87c0-287bc9498ac0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.055181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3773c-db08-4a20-87c0-287bc9498ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.055364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3773c-db08-4a20-87c0-287bc9498ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.078488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6de3773c-db08-4a20-87c0-287bc9498ac0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:32.079650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6de3773c-db08-4a20-87c0-287bc9498ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:32.081742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.082537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.082934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.083213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.083981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:32.084292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:32.085845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:32.098285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 458/951] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:32.110330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.172913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:32.210311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 494/952] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:32.252366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9c99-e3fb-4e81-9d77-33f8f155c06c None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.316453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.318076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.318919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.319752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.342962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:32.355473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:32.355670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3773c-db08-4a20-87c0-287bc9498ac0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:32.363281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:32.365004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:32.366694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:32.366694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:32.366694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:32.366694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 459/953] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:32.377555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.495910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:32.504478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3773c-db08-4a20-87c0-287bc9498ac0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.546000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402791-62b2-488b-b697-19393121705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.547194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402791-62b2-488b-b697-19393121705b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.547542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402791-62b2-488b-b697-19393121705b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.548385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402791-62b2-488b-b697-19393121705b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.549101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402791-62b2-488b-b697-19393121705b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:32.551217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402791-62b2-488b-b697-19393121705b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-77402791-62b2-488b-b697-19393121705b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:32.561588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:32.563676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:32.565880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:32.571752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 495/954] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:32.573202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402791-62b2-488b-b697-19393121705b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.617254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:32.624164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291b8f-ed7e-42ca-b442-1d770a65dbf0 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.673998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.675616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.676187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.676487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.677475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:32.677906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:32.680180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:32.698964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 460/955] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:32.700495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.715490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402791-62b2-488b-b697-19393121705b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.786996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.788039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.788533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.789031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.790177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:32.790744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:32.793357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:32.804273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 496/956] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:32.804273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.841231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f816-4107-42f1-82e3-430f126c575e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.844317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:32.898453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.899457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.899942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.900438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.901604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:32.904425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:32.909633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING keystone.server.flask.common [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 20:01:32.965925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.sql.core [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 20:01:32.965925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 20:01:32.965925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [parameters: {'id': '6ecf7e02e0db43719061095bd22006f2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 20:01:32.965925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81779) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ecf7e02e0db43719061095bd22006f2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ecf7e02e0db43719061095bd22006f2. Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:32.974309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 20:01:32.980073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application yield resource Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise self.value Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application session.commit() Aug 17 20:01:32.982048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.session.flush() Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application compat.raise_( Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 20:01:32.983761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 20:01:32.989561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:32.994354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [parameters: {'id': '6ecf7e02e0db43719061095bd22006f2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:32.997713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:33.001002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ecf7e02e0db43719061095bd22006f2. Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 461/957] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 17 20:01:32 2022] POST /identity/v3/projects => generated 262 bytes in 276 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:33.005364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.008256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc22f7-6a2d-42b8-a249-0c871b1344f5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.008459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.059042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.060165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.060670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.061163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.076105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.078868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:33.102878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:33.103946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:33.104894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:33.112920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 497/958] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:33.114554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.131528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc2f8-9e1d-485d-99f9-a47f2202409b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.190404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.192134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.192658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.193147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.194008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:33.194517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.196332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.211462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 462/959] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:33.211462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.259109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.276165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd15e-9a4f-4371-b2da-31bea67a71d7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.338050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.339674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.340898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.341378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.341947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.356466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.359340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.361689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc720a-2bce-413e-97fb-455015ea21c3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:33.382462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:33.383565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:33.384546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:33.391153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 498/960] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:33.392890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.418274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.419276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.419707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.420167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.421421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:33.421842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.424330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.462775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 463/961] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:33.462775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.574761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024df3d-d038-40d3-a2c8-c3fbbdefae86 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.627035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199a744-08b2-4100-bea2-3ca41866f735 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.629921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300383-402c-45b9-a483-7093b55faa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.630672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300383-402c-45b9-a483-7093b55faa53 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.631136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300383-402c-45b9-a483-7093b55faa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.631588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300383-402c-45b9-a483-7093b55faa53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.632468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300383-402c-45b9-a483-7093b55faa53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.634545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300383-402c-45b9-a483-7093b55faa53 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.678191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.678855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.679135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.679406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.680073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:33.680368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.681839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.693952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.701924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 464/962] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:33.702876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.722548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.748092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 499/963] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:33.851860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325792c-d148-4906-aed3-916109bb42a4 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.852510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325792c-d148-4906-aed3-916109bb42a4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.852958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325792c-d148-4906-aed3-916109bb42a4 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.853799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ffe06-95e2-4406-acd0-f8328ed535d8 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.856012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 500/964] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:33.864236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2a1e-c8eb-488b-be19-751da4d8347c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.864740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2a1e-c8eb-488b-be19-751da4d8347c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.865125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2a1e-c8eb-488b-be19-751da4d8347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.889528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-02da2a1e-c8eb-488b-be19-751da4d8347c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:33.891191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-02da2a1e-c8eb-488b-be19-751da4d8347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:33.904947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.905649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.905936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.906215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.007930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.018077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.020780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.046042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 501/965] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:34.225027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 465/966] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:34.233685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2a1e-c8eb-488b-be19-751da4d8347c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.340450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.420208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2a1e-c8eb-488b-be19-751da4d8347c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.470906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.478075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.479007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.479470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.479904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.491821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.493740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.493866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98873-c50e-46fa-a3bc-326804cc8da1 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.498340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:34.512108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:34.513249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:34.514386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:34.514386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:34.514386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:34.517804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 502/967] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:34.525971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.556128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.557319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.557811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.558283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.559444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.561897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:34.575818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:34.578058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:34.580004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:34.591265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 466/968] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:34.595010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.703986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320243-86a4-4704-ab95-fdad42cfd605 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.765276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.766369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.766751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.767105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.767876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:34.768362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.771309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.782175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc275a-e375-41ac-b4c5-148818385e12 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.789517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 503/969] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:34.795747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.856590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.858098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.859166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.861385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.863655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.865193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:34.866055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.869313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.879267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 467/970] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:34.885711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.935160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.984411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a279fc-3331-42bf-87a0-43b338725da8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.028887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b15272-966c-4c45-b060-7fd3d7443e56 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.075385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.075859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.076484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.076775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.077030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.077783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.078084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.078842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.079497 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.079915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.081775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.090978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 468/971] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:35.102744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.106250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:35.132411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:35.134075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:35.136019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:35.140448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 504/972] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:35.147690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.328922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:35.345212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75a2d-decc-4417-8d14-ab6fedfe0962 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.413283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680e008-b8a2-4748-8daf-fd46ecadada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.414212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680e008-b8a2-4748-8daf-fd46ecadada3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.414710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680e008-b8a2-4748-8daf-fd46ecadada3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.415200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680e008-b8a2-4748-8daf-fd46ecadada3 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.416433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680e008-b8a2-4748-8daf-fd46ecadada3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.416953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680e008-b8a2-4748-8daf-fd46ecadada3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.419757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680e008-b8a2-4748-8daf-fd46ecadada3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.443505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 469/973] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:35.456759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.626897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397a04e-6cce-4219-8781-ed3400471f53 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.629054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:35.666062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad99db4-e6d0-429a-bbe8-78a0d4d401cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.666601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad99db4-e6d0-429a-bbe8-78a0d4d401cf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.666919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad99db4-e6d0-429a-bbe8-78a0d4d401cf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.667282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad99db4-e6d0-429a-bbe8-78a0d4d401cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.667944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad99db4-e6d0-429a-bbe8-78a0d4d401cf None admin] RBAC: Adding query filter params (role.id=c85ea3ef4c554385b91a4692fc8b791a, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=31e687163dec4063a3932d164b06654e) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.677473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad99db4-e6d0-429a-bbe8-78a0d4d401cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.679060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad99db4-e6d0-429a-bbe8-78a0d4d401cf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.686238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 505/974] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/role_assignments?user.id=31e687163dec4063a3932d164b06654e&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=c85ea3ef4c554385b91a4692fc8b791a => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:35.904898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c53c-0642-4f3e-98cf-aeb366dd9e3c None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.905272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c53c-0642-4f3e-98cf-aeb366dd9e3c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.905654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c53c-0642-4f3e-98cf-aeb366dd9e3c None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.907227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 470/975] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:35.913848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f323-c572-4b81-8026-d7e25ace4cdd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.914616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f323-c572-4b81-8026-d7e25ace4cdd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.914616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f323-c572-4b81-8026-d7e25ace4cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.935293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a843f323-c572-4b81-8026-d7e25ace4cdd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:35.936442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a843f323-c572-4b81-8026-d7e25ace4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:36.019645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 506/976] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:36.298269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566c53c-0642-4f3e-98cf-aeb366dd9e3c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:36.432977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566c53c-0642-4f3e-98cf-aeb366dd9e3c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:36.493763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd1c9-0f16-4894-8bd5-0fb8e1a36d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:36.494832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd1c9-0f16-4894-8bd5-0fb8e1a36d1a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.495316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd1c9-0f16-4894-8bd5-0fb8e1a36d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.495791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd1c9-0f16-4894-8bd5-0fb8e1a36d1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.496821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd1c9-0f16-4894-8bd5-0fb8e1a36d1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:36.499230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd1c9-0f16-4894-8bd5-0fb8e1a36d1a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-d2bfd1c9-0f16-4894-8bd5-0fb8e1a36d1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:36.516365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:36.517419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:36.519237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:36.520110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 471/977] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:36.525005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f323-c572-4b81-8026-d7e25ace4cdd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:36.640741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c9562-3c1a-444e-b46f-2289920cec53 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.641383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c9562-3c1a-444e-b46f-2289920cec53 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.641943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c9562-3c1a-444e-b46f-2289920cec53 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.644512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 472/978] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:36.650696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675744-674f-4f2d-9408-3c0a6928a14e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.651266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675744-674f-4f2d-9408-3c0a6928a14e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.651839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675744-674f-4f2d-9408-3c0a6928a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.673211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:36.674264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e8675744-674f-4f2d-9408-3c0a6928a14e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:36.677994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e8675744-674f-4f2d-9408-3c0a6928a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:36.681641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:36.688627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f323-c572-4b81-8026-d7e25ace4cdd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:36.761252 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:36.762499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.762762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.763240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.764373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:36.764911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:36.767447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:36.782654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 507/979] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:36.782845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 473/980] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:36.783590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:36.973547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674251ec-39e0-4a32-b6f1-d4fdff9c68d9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.038228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.039329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.039832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.040326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.041685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:37.042233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.044981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.056467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 508/981] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:37.063825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675744-674f-4f2d-9408-3c0a6928a14e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.196278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.243583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:37.249395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675744-674f-4f2d-9408-3c0a6928a14e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.322013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.323256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.323763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.324306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.325839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] RBAC: Adding query filter params (interface=admin, service_id=cee2e7daf31748b6af31f702f8ba29c0, region_id=RegionOne) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:37.326415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.329218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.340261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 474/982] 10.222.0.64 () {56 vars in 1249 bytes} [Wed Aug 17 20:01:37 2022] GET /identity/v3/endpoints?service_id=cee2e7daf31748b6af31f702f8ba29c0&interface=admin®ion_id=RegionOne => generated 193 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:37.345757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.350298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:37.390739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255d7f7-3986-46e5-97ca-14bd39591ff4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.459271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.460314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.460813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.461292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.462471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.465313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.470204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING keystone.server.flask.common [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 20:01:37.494147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9c89c-2741-4d76-a807-f604a4d5165e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.521513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.sql.core [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 20:01:37.521513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 20:01:37.521513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [parameters: {'user_id': '0a2e59f330a54a319f4acec582795e06', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 20:01:37.521513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81778) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 20:01:37.542318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.543130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.543486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.543853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.544567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.546097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.562555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 475/983] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:37 2022] GET /identity/v3/services => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:37.564860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:37.567556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application yield resource Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise self.value Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application session.commit() Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 20:01:37.569487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.session.flush() Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application compat.raise_( Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 20:01:37.575178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:37.577190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:37.578864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [parameters: {'user_id': '0a2e59f330a54a319f4acec582795e06', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:37.580522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 20:01:37.585967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 20:01:37.589716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 20:01:37.589716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 20:01:37.589716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 20:01:37.589716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 20:01:37.589716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 20:01:37.589716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:37.589716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 509/984] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 17 20:01:37 2022] POST /identity/v3/users => generated 160 bytes in 379 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:37.591215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.723170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:37.793610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339c233-e8bd-4075-8a49-025b6c15e632 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.863359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d4aa7-c95c-406e-9cb6-f7b62a70b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.865005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d4aa7-c95c-406e-9cb6-f7b62a70b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.865774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d4aa7-c95c-406e-9cb6-f7b62a70b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.866535 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d4aa7-c95c-406e-9cb6-f7b62a70b8d9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.881926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d4aa7-c95c-406e-9cb6-f7b62a70b8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.885255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d4aa7-c95c-406e-9cb6-f7b62a70b8d9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-647d4aa7-c95c-406e-9cb6-f7b62a70b8d9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:37.911470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:37.913369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:01:37.916052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:37.920788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 476/985] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:37.926918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:38.051336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e37f43-5d4d-4021-aec9-a0baf533838d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.051878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e37f43-5d4d-4021-aec9-a0baf533838d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.052227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e37f43-5d4d-4021-aec9-a0baf533838d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.061907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 477/986] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:38.063797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:38.064455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a77a-7de9-49d5-bcd9-6f33c5abc0d9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.065011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a77a-7de9-49d5-bcd9-6f33c5abc0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.065537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a77a-7de9-49d5-bcd9-6f33c5abc0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.089707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972e25-5f05-4bb2-812f-922716afee06 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:38.101916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d567a77a-7de9-49d5-bcd9-6f33c5abc0d9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:38.104088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d567a77a-7de9-49d5-bcd9-6f33c5abc0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:38.165194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251ffab-df4d-48df-9e83-e2705a606316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:38.166255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251ffab-df4d-48df-9e83-e2705a606316 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.166954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251ffab-df4d-48df-9e83-e2705a606316 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.167448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251ffab-df4d-48df-9e83-e2705a606316 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.168927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251ffab-df4d-48df-9e83-e2705a606316 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:38.169471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251ffab-df4d-48df-9e83-e2705a606316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:38.172707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251ffab-df4d-48df-9e83-e2705a606316 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:38.249099 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 478/987] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:38.252409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 510/988] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 17 20:01:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:38.503344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f858f-4922-4bf2-ab03-597a75fd812b None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.504118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f858f-4922-4bf2-ab03-597a75fd812b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.504118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f858f-4922-4bf2-ab03-597a75fd812b None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.505634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 479/989] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:38.511576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3212-ded9-4a32-a2b7-f240de289f15 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.511904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3212-ded9-4a32-a2b7-f240de289f15 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.512122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3212-ded9-4a32-a2b7-f240de289f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.533432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9fbf3212-ded9-4a32-a2b7-f240de289f15 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:38.535927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9fbf3212-ded9-4a32-a2b7-f240de289f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:38.628920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 511/990] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:38.687873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f858f-4922-4bf2-ab03-597a75fd812b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:38.757701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:38.808258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f858f-4922-4bf2-ab03-597a75fd812b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:38.850242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:38.851063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.851473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.851877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.852679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:38.854252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:38.898405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3212-ded9-4a32-a2b7-f240de289f15 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:38.938170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 480/991] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:38 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:01:38.993326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:39.025809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3212-ded9-4a32-a2b7-f240de289f15 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:39.080632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:39.081703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.081703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.082202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] PATH_INFO: `/v3/services/image` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.083161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:39.084569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:39.094598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:39.097160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:39.098928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:39.102237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 512/992] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 17 20:01:38 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:39.103467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:39.272236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd197a-8d66-4640-902a-3e08aec20f82 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:39.294806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:39.317191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c47af-6bf2-4445-a606-3d20de5f98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:39.318018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c47af-6bf2-4445-a606-3d20de5f98a2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.318424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c47af-6bf2-4445-a606-3d20de5f98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.318965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c47af-6bf2-4445-a606-3d20de5f98a2 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.319750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c47af-6bf2-4445-a606-3d20de5f98a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:39.320180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c47af-6bf2-4445-a606-3d20de5f98a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:39.321772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c47af-6bf2-4445-a606-3d20de5f98a2 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:39.333164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 481/993] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:39.335502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:39.486732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e932-dc11-41fc-821f-d321b03d3225 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:39.530375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba7514-c564-4413-9540-2af517dbbfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:39.531027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7514-c564-4413-9540-2af517dbbfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.531316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7514-c564-4413-9540-2af517dbbfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.531595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7514-c564-4413-9540-2af517dbbfd4 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.532245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7514-c564-4413-9540-2af517dbbfd4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:39.532553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7514-c564-4413-9540-2af517dbbfd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:39.534001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7514-c564-4413-9540-2af517dbbfd4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:39.535856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:39.543265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 513/994] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:40.110112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a75d-99ec-42bb-ad3f-aed62003c1c8 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.110980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a75d-99ec-42bb-ad3f-aed62003c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.110980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a75d-99ec-42bb-ad3f-aed62003c1c8 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.112905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 482/995] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:40.119544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e1f71-8c5a-46f1-bd14-ba01dadedbd6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.120344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e1f71-8c5a-46f1-bd14-ba01dadedbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.120863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e1f71-8c5a-46f1-bd14-ba01dadedbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.150183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1c0e1f71-8c5a-46f1-bd14-ba01dadedbd6 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:40.152303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1c0e1f71-8c5a-46f1-bd14-ba01dadedbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:40.242692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 514/996] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:40.745227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4a75d-99ec-42bb-ad3f-aed62003c1c8 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:40.952747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4a75d-99ec-42bb-ad3f-aed62003c1c8 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.011975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.013480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.015985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.016741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.018089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.020794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:41.037702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:41.039588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:41.041118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:41.045924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 483/997] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:41.053856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e1f71-8c5a-46f1-bd14-ba01dadedbd6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.213881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e1f71-8c5a-46f1-bd14-ba01dadedbd6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.242929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.253490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.254359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.254656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.254956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.255603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:41.255915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.257369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.263863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 515/998] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:41.269470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.348160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.462532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2161-8096-4c34-8203-cdc55b149e63 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.523921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcfb66-0b4a-4d57-af15-5af700c8038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.524872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcfb66-0b4a-4d57-af15-5af700c8038d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.525357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcfb66-0b4a-4d57-af15-5af700c8038d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.525837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcfb66-0b4a-4d57-af15-5af700c8038d None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.527008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcfb66-0b4a-4d57-af15-5af700c8038d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:41.527810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcfb66-0b4a-4d57-af15-5af700c8038d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.529957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcfb66-0b4a-4d57-af15-5af700c8038d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.537740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 484/999] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:41.544283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.572359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314feff-b2e6-43bf-b382-64c430c5c72f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.572769 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314feff-b2e6-43bf-b382-64c430c5c72f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.573053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314feff-b2e6-43bf-b382-64c430c5c72f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.574470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 485/1000] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:41.579756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9dd0a-6229-4977-aade-d7cd08b6d651 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.580042 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9dd0a-6229-4977-aade-d7cd08b6d651 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.580324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9dd0a-6229-4977-aade-d7cd08b6d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.600096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-91f9dd0a-6229-4977-aade-d7cd08b6d651 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:41.601294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-91f9dd0a-6229-4977-aade-d7cd08b6d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:41.683741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b37e-728c-4adf-9de1-48a3e635d66f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.706456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 486/1001] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:41.733366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.734292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.734574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.734877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.735562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.737454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.757984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ccebf-058e-4aad-b250-cf8ca1449946 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.758377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ccebf-058e-4aad-b250-cf8ca1449946 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.758687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ccebf-058e-4aad-b250-cf8ca1449946 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.760266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 487/1002] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:41.765627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d62a-c6b9-4e8b-807f-a371ab0a8215 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.765999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d62a-c6b9-4e8b-807f-a371ab0a8215 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.766349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d62a-c6b9-4e8b-807f-a371ab0a8215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.797798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e4b5d62a-c6b9-4e8b-807f-a371ab0a8215 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:41.799921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e4b5d62a-c6b9-4e8b-807f-a371ab0a8215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:41.809207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 516/1003] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:41.859513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.940819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 488/1004] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:41.989956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.076226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:42.142203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2d1d0-a436-4670-a0c3-84d152db80f4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.180785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.181415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.181697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.181974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.182689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.184116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.261304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 517/1005] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:41 2022] POST /identity/v3/services => generated 242 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:42.314380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5d62a-c6b9-4e8b-807f-a371ab0a8215 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.510808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5d62a-c6b9-4e8b-807f-a371ab0a8215 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.560757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.561460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.561716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.561969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.562552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.564031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:42.575304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:42.577224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:42.579001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 489/1006] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:42.586526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.794605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cb4f3-6735-4c08-98a4-d0dcfb258865 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.821196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:42.861751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.863500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.864060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.864547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.865649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:42.866148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.868744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.886058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 518/1007] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:42.887131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.922004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:43.007952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81ed0f-edce-49b3-a307-4c8780a3049a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:43.047661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:43.048176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:43.048459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:43.048734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:43.049983 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:43.050287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:43.051716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:43.062720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 490/1008] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:43.067219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:43.265138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930c45-2ba7-4b93-a430-98911011ae47 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:43.332669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7435865-0d59-4b84-9812-e53a32aa425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:43.333528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435865-0d59-4b84-9812-e53a32aa425a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:43.334032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435865-0d59-4b84-9812-e53a32aa425a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:43.334503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435865-0d59-4b84-9812-e53a32aa425a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:43.335890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7435865-0d59-4b84-9812-e53a32aa425a None admin] RBAC: Adding query filter params (interface=public, service_id=36e2547758ee4c3db094dfdb9d8ad83d, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:43.336436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7435865-0d59-4b84-9812-e53a32aa425a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:43.338833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7435865-0d59-4b84-9812-e53a32aa425a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:43.352579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 519/1009] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:43 2022] GET /identity/v3/endpoints?service_id=36e2547758ee4c3db094dfdb9d8ad83d&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:43.358196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:43.556442 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:43.574122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb6a6e-a5e9-49fd-b21c-038881d320f3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:43.635177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d8c53-e1a8-418b-a35b-934957c25403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:43.635795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d8c53-e1a8-418b-a35b-934957c25403 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:43.636070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d8c53-e1a8-418b-a35b-934957c25403 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:43.636335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d8c53-e1a8-418b-a35b-934957c25403 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:43.636939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d8c53-e1a8-418b-a35b-934957c25403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:43.638301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d8c53-e1a8-418b-a35b-934957c25403 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:43.654681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 491/1010] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:43 2022] GET /identity/v3/services => generated 1957 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:43.951125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518667d-27e1-4942-8979-bb5b82ec7294 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:43.951384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518667d-27e1-4942-8979-bb5b82ec7294 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:43.951716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518667d-27e1-4942-8979-bb5b82ec7294 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:43.953171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 520/1011] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:43.959254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72be96c-e8c4-4278-bbcf-7e3aa17a20da None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:43.959639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72be96c-e8c4-4278-bbcf-7e3aa17a20da None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:43.959808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72be96c-e8c4-4278-bbcf-7e3aa17a20da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:43.980385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c72be96c-e8c4-4278-bbcf-7e3aa17a20da None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:43.981579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c72be96c-e8c4-4278-bbcf-7e3aa17a20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:44.061051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 492/1012] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:44.332531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518667d-27e1-4942-8979-bb5b82ec7294 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:44.380427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:44.444550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518667d-27e1-4942-8979-bb5b82ec7294 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:44.480355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f951b5-9ede-4677-91eb-fb755a757ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:44.481000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f951b5-9ede-4677-91eb-fb755a757ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.481281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f951b5-9ede-4677-91eb-fb755a757ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.481557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f951b5-9ede-4677-91eb-fb755a757ab1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.482729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f951b5-9ede-4677-91eb-fb755a757ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:44.484173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f951b5-9ede-4677-91eb-fb755a757ab1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:44.485935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 521/1013] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:44.491911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72be96c-e8c4-4278-bbcf-7e3aa17a20da None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:44.581553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:44.598457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72be96c-e8c4-4278-bbcf-7e3aa17a20da None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:44.634216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:44.634859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.635142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.635419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.636079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:44.637648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:44.639370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5a66-00fe-43e7-b619-28c58be983ec None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.639873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5a66-00fe-43e7-b619-28c58be983ec None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.640361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5a66-00fe-43e7-b619-28c58be983ec None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.647237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 522/1014] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:44.648985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162d168-04c3-4f43-a959-12b703217c44 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.649267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162d168-04c3-4f43-a959-12b703217c44 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.649544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162d168-04c3-4f43-a959-12b703217c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.669142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c162d168-04c3-4f43-a959-12b703217c44 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:44.671761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c162d168-04c3-4f43-a959-12b703217c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:44.748703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 523/1015] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:44 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:44.752440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 493/1016] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:44 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:45.026014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162d168-04c3-4f43-a959-12b703217c44 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.074123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.148233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162d168-04c3-4f43-a959-12b703217c44 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.189597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.190816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.191101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.191383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] PATH_INFO: `/v3/services/image` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.191983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.193380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:45.203813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:45.206482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:45.209854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:45.216263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 524/1017] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:45.216480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.331169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561163a-cc42-46d3-8240-202add4a0700 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.371605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.372243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.372534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.372817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.373451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] RBAC: Adding query filter params (name=image) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:45.373755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.375197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.378126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.387219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 494/1018] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:45.398786 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.514092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358595-9cbf-412c-9c7f-c64d42693c09 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.516222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.559784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.560409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.560723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.560971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.561613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] RBAC: Adding query filter params (type=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:45.561921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.563363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.575291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 525/1019] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:45.577441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.743879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8b6b-9aa6-4db0-8566-59229ea586db None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.785498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faf66a-7f26-48cc-93df-5635ec273dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.786131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf66a-7f26-48cc-93df-5635ec273dcb None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.786423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf66a-7f26-48cc-93df-5635ec273dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.786734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf66a-7f26-48cc-93df-5635ec273dcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.787457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4faf66a-7f26-48cc-93df-5635ec273dcb None admin] RBAC: Adding query filter params (interface=public, service_id=b6e6ec2e90c8409e969c2fc00e123604, region_id=RegionOne) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:45.787769 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4faf66a-7f26-48cc-93df-5635ec273dcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.789167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4faf66a-7f26-48cc-93df-5635ec273dcb None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.795640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 495/1020] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/endpoints?service_id=b6e6ec2e90c8409e969c2fc00e123604&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:45.802023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.943065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085389-4740-477c-b1fd-798dedd14f4c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.983058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b07551-a19c-4fda-a43c-4a422aa6e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.983683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b07551-a19c-4fda-a43c-4a422aa6e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.983962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b07551-a19c-4fda-a43c-4a422aa6e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.984235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b07551-a19c-4fda-a43c-4a422aa6e2a4 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.984841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b07551-a19c-4fda-a43c-4a422aa6e2a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.986213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b07551-a19c-4fda-a43c-4a422aa6e2a4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.994331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 526/1021] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services => generated 1957 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:01:46.636929 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917f4b-0e0c-4b24-bc18-3784ef0e618f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.637460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917f4b-0e0c-4b24-bc18-3784ef0e618f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.637460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917f4b-0e0c-4b24-bc18-3784ef0e618f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.638856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 496/1022] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:46.648115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5cee-7c6d-4cee-92d0-d140281561ab None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.648665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5cee-7c6d-4cee-92d0-d140281561ab None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.648868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5cee-7c6d-4cee-92d0-d140281561ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.680116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-868b5cee-7c6d-4cee-92d0-d140281561ab None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:46.682389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-868b5cee-7c6d-4cee-92d0-d140281561ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:46.730414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.787574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73787ba8-00a3-4ce3-a930-f96f51182a6d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.788045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73787ba8-00a3-4ce3-a930-f96f51182a6d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.788439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73787ba8-00a3-4ce3-a930-f96f51182a6d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.790292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 497/1023] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:46.796676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6711-b857-4790-803a-b1a8f4f50215 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.797118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6711-b857-4790-803a-b1a8f4f50215 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.797543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6711-b857-4790-803a-b1a8f4f50215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.816823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 527/1024] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:46 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:46.821427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-110a6711-b857-4790-803a-b1a8f4f50215 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:46.822973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-110a6711-b857-4790-803a-b1a8f4f50215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:46.896911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.907592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 498/1025] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:46 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:47.180638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b5cee-7c6d-4cee-92d0-d140281561ab None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.305377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a6711-b857-4790-803a-b1a8f4f50215 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.314093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b5cee-7c6d-4cee-92d0-d140281561ab None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.386184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.387304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.387812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.388323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.390506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.393266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.398922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 528/1026] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:47.406329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.455100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:47.477818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a6711-b857-4790-803a-b1a8f4f50215 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.540857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.541910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.542400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.542926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.543984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.546543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:47.562412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:47.564412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:47.566005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 499/1027] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:47.572540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.586450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3b8af-455e-48d9-a9ed-533c2d6d871c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.638132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.638885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.639232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.639908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.640198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.641616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.657898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:47.708035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc88ba-7462-4004-b4be-16e26a97bfd4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.744113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 529/1028] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:01:47 2022] POST /identity/v3/users => generated 285 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:47.755283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567d9f-31ff-402a-82b0-2907ed4fdca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.756375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567d9f-31ff-402a-82b0-2907ed4fdca7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.756952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567d9f-31ff-402a-82b0-2907ed4fdca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.757455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567d9f-31ff-402a-82b0-2907ed4fdca7 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.758881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567d9f-31ff-402a-82b0-2907ed4fdca7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:47.759428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567d9f-31ff-402a-82b0-2907ed4fdca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.762248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567d9f-31ff-402a-82b0-2907ed4fdca7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.779231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 500/1029] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:47.783915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.946777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:47.969160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21950-97ba-4921-af8c-3d667c159909 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.023927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb761-415b-4c02-8eed-49ea934d699c None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.024298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb761-415b-4c02-8eed-49ea934d699c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.024514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb761-415b-4c02-8eed-49ea934d699c None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.026559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 501/1030] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:48.032207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.032735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273e96-a74b-4161-8f4b-99ab9563340a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.033224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273e96-a74b-4161-8f4b-99ab9563340a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.033328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.034246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.034560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273e96-a74b-4161-8f4b-99ab9563340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.034790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.035892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:48.036419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.038956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.048001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 530/1031] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:48.056470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:48.059245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-aa273e96-a74b-4161-8f4b-99ab9563340a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:48.060453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-aa273e96-a74b-4161-8f4b-99ab9563340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:48.169962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 502/1032] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:48 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:48.206362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333f715-e671-4b0f-8e16-f80bef6e01f2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.268246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.268920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.269197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.269464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.270162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.271834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.379482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 531/1033] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:01:48.467908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273e96-a74b-4161-8f4b-99ab9563340a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:48.549990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:48.612337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273e96-a74b-4161-8f4b-99ab9563340a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.663482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.664237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.664428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.664707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] PATH_INFO: `/v3/services/image` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.665321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.666868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:48.677942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:48.680650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:48.683613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 503/1034] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 17 20:01:48 2022] GET /identity/v3/services/image => generated 86 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:48.687084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:48.692089 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:48.864200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702585-5eb4-4312-9466-66dfe61be1fb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.925894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.926973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.927485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.927967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.929078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] RBAC: Adding query filter params (name=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:48.929615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.932217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.946676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 532/1035] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:48.950170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:49.087515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf659e1-9663-402b-86a5-6f27a3b8a025 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:49.102051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:49.126404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9823-4348-4c7c-852e-2dce67cfda99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:49.126892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9823-4348-4c7c-852e-2dce67cfda99 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:49.127039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9823-4348-4c7c-852e-2dce67cfda99 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:49.127501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9823-4348-4c7c-852e-2dce67cfda99 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:49.128438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9823-4348-4c7c-852e-2dce67cfda99 None admin] RBAC: Adding query filter params (type=image) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:49.128875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9823-4348-4c7c-852e-2dce67cfda99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:49.130355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9823-4348-4c7c-852e-2dce67cfda99 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:49.136147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 504/1036] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:49.143269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:49.257544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:49.320398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785655b-1e2d-4460-abe7-c037cd03f01b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:49.383294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7146c06-bdca-4895-a1ce-28a0e7a3f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:49.384227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7146c06-bdca-4895-a1ce-28a0e7a3f1a2 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:49.384717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7146c06-bdca-4895-a1ce-28a0e7a3f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:49.385205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7146c06-bdca-4895-a1ce-28a0e7a3f1a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:49.386399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7146c06-bdca-4895-a1ce-28a0e7a3f1a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:49.388946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7146c06-bdca-4895-a1ce-28a0e7a3f1a2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:49.508395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 533/1037] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:49.897198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c440eb-40d1-47db-95eb-0337ae6b987a None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:49.898018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c440eb-40d1-47db-95eb-0337ae6b987a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:49.898018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c440eb-40d1-47db-95eb-0337ae6b987a None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:49.899400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 505/1038] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:49.908533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5eebd-ee72-464f-99cb-3f1902636def None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:49.909144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5eebd-ee72-464f-99cb-3f1902636def None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:49.909583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5eebd-ee72-464f-99cb-3f1902636def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:49.939341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e1a5eebd-ee72-464f-99cb-3f1902636def None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:49.941721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e1a5eebd-ee72-464f-99cb-3f1902636def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:50.067058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 534/1039] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:50.341110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c440eb-40d1-47db-95eb-0337ae6b987a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:50.532852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c440eb-40d1-47db-95eb-0337ae6b987a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:50.593929 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:50.594959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.595459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.596504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.616606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:50.625197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee6563-45d2-45fd-91df-a3356563dd73 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.625492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee6563-45d2-45fd-91df-a3356563dd73 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.625774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee6563-45d2-45fd-91df-a3356563dd73 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:50.626581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:50.628147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:50.631870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:50.633395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 535/1040] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:50.633551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 506/1041] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:50.634048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6bb6-f0f6-4c4f-91f5-7b3ce7d6f275 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.634384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6bb6-f0f6-4c4f-91f5-7b3ce7d6f275 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.634667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6bb6-f0f6-4c4f-91f5-7b3ce7d6f275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.634939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:50.653570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8ebb6bb6-f0f6-4c4f-91f5-7b3ce7d6f275 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:50.654824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8ebb6bb6-f0f6-4c4f-91f5-7b3ce7d6f275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:50.690202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:50.754361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:50.787094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa94fec-7419-4d24-b352-7dc8559036d7 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:50.792245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 536/1042] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:50.850255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:50.851238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.851759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.852269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.853416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:50.854043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:50.856423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:50.878214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 507/1043] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:50.879815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6bb6-f0f6-4c4f-91f5-7b3ce7d6f275 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.011271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6bb6-f0f6-4c4f-91f5-7b3ce7d6f275 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.051300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.051933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.052217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.052475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] PATH_INFO: `/v3/users/8cc27cbf2e54427390723fe139804cf1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.068434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] RBAC: Authorizing `identity:get_user(user_id=8cc27cbf2e54427390723fe139804cf1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.070019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.072858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 537/1044] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:01:50 2022] GET /identity/v3/users/8cc27cbf2e54427390723fe139804cf1 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:51.073071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.077550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.124446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.223795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f48e-9ec3-45a1-8102-9d9d1e466d9e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.255608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.260872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48515c5a-f648-43c4-a3ba-eefda831141b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.285339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.286453 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.286987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.287469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.306736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.313106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.313106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.313106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.323076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:51.329020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:51.330257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:51.331784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:51.334115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 508/1045] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:51.343323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.402445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.404073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.462087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.504811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2729dd-b6b0-4b3c-9997-411700863440 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.560702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.561740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.562137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.562574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.563843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:51.564390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.568155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.569273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 538/1046] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:01:51.570098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.596520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 509/1047] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:51.599045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.637395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.708642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844ce5b-81f0-4b25-95e9-ce7957ad6ad1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.730002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2cf6-8351-43bd-a253-2c067b13275d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.751429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84462926-f78a-4b0a-a4df-952e250c08d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.752577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84462926-f78a-4b0a-a4df-952e250c08d1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.752842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84462926-f78a-4b0a-a4df-952e250c08d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.753116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84462926-f78a-4b0a-a4df-952e250c08d1 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.754442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84462926-f78a-4b0a-a4df-952e250c08d1 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0ac2791fbf426fbdb89ef5486d3f36)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.755942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84462926-f78a-4b0a-a4df-952e250c08d1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.757689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 539/1048] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36 => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:51.759004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51276e2c-f1f4-4f32-9b54-0eb02f7e680f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.759291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51276e2c-f1f4-4f32-9b54-0eb02f7e680f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.759569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51276e2c-f1f4-4f32-9b54-0eb02f7e680f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.760827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 540/1049] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:51.766119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51276e2c-f1f4-4f32-9b54-0eb02f7e680f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.775661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.777457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505398a-101e-4389-8026-c7d003817d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.778259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505398a-101e-4389-8026-c7d003817d99 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.778809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505398a-101e-4389-8026-c7d003817d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.779306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505398a-101e-4389-8026-c7d003817d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.796085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505398a-101e-4389-8026-c7d003817d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.797546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505398a-101e-4389-8026-c7d003817d99 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-f505398a-101e-4389-8026-c7d003817d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:51.820429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:51.822489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:51.824171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:51.824171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:51.824171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:51.824171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 510/1050] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:51.824171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0cea5-18be-4871-9f26-dc3f63e112d1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.824171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0cea5-18be-4871-9f26-dc3f63e112d1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.824171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0cea5-18be-4871-9f26-dc3f63e112d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.844997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ead0cea5-18be-4871-9f26-dc3f63e112d1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:51.846950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ead0cea5-18be-4871-9f26-dc3f63e112d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:51.900432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51276e2c-f1f4-4f32-9b54-0eb02f7e680f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.937489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.937997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.938276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.938549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.939305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36, user.id=8cc27cbf2e54427390723fe139804cf1) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:51.940147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.941625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 511/1051] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:51.941797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.942878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0cea5-18be-4871-9f26-dc3f63e112d1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.946917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.955752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 541/1052] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/role_assignments?user.id=8cc27cbf2e54427390723fe139804cf1&scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:52.140210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0cea5-18be-4871-9f26-dc3f63e112d1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.184083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.184712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.184986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.185258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.185913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:52.186215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:52.187724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:52.207079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 512/1053] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:52.208506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:52.264482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:52.299767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:52.347375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d838af0-146a-4ae1-842f-bfb38020b7f5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.368590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:52.403232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.403887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.404405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.404581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.414726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:52.416201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:52.427295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084ad9d-af67-4735-9364-5a42d424c67a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:52.429845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:52.431788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:52.435329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 542/1054] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:52.437391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:52.492021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.492943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.493402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.493900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.561511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd21b6f-5150-47d8-a419-b76ea8116f4c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.593796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:52.600937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.604054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.604054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.604054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.604054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:52.604054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:52.604644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:52.611801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:52.614590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:52.630496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 543/1055] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:52.631685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:52.724724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:52.751308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b70cc-7896-4482-a63d-9654bca9197f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.792380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.793527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.793962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.794213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 513/1056] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:01:52.794572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.799444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:52.876630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:52.892124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:52.894751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:52.918778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a65f0c-ee9f-44ab-9c03-21f5b68c3f90 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.980399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.981319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.981808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.982319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.000923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.004283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.009698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 544/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:01:53.015250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:53.031628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:53.032648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:53.033795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:53.033795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:53.033795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:53.035137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 514/1058] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:53.040880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.060472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:53.153330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:53.168157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785293d8-61e2-42d3-82e9-5e38bffa5b30 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.188743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5896-0cc7-4809-8c25-7ac4c468cc76 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.209720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.210536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.210887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.211168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.223452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.224911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.238668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.239452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.239769 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.240200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.241257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:53.241572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:53.241864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:53.243587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:53.245393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:53.245393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:53.245393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:53.245707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.247931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 545/1059] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:53.248843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.260925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 515/1060] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:53.428933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ddb94-f264-42ad-aae1-f52a49675acf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.481984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.483595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.483891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.484168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.485179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:53.485914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.488040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.498925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:53.509399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 546/1061] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:53.515204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.626889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:53.654992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125af0c-c640-4a19-85a3-9cdf2ea26162 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.712252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.713203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.713703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.714197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.726652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.728814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:53.750966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:53.752080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:53.752960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:53.753409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 516/1062] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:53.759432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.871634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dbc23-7af2-4c67-8558-a7e35282f6bf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.906755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602391d-27c0-444c-aefd-8e9139bffc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.907358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602391d-27c0-444c-aefd-8e9139bffc32 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.907635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602391d-27c0-444c-aefd-8e9139bffc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.907908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602391d-27c0-444c-aefd-8e9139bffc32 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.909171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602391d-27c0-444c-aefd-8e9139bffc32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:53.909473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602391d-27c0-444c-aefd-8e9139bffc32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.911280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602391d-27c0-444c-aefd-8e9139bffc32 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.924030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 547/1063] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:53.933457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.988937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3b40-7c51-499e-8ee4-b433011c99c5 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.989438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3b40-7c51-499e-8ee4-b433011c99c5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.989850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3b40-7c51-499e-8ee4-b433011c99c5 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.991717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 548/1064] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:53.997982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c08eec-cc80-4651-8ee1-b23ce5eefd18 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.998248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c08eec-cc80-4651-8ee1-b23ce5eefd18 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.998528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c08eec-cc80-4651-8ee1-b23ce5eefd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.019231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c3c08eec-cc80-4651-8ee1-b23ce5eefd18 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:54.020488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c3c08eec-cc80-4651-8ee1-b23ce5eefd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:54.057320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed7785-535f-4716-87f5-83b73c342ce3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:54.088803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:54.097225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:54.097846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.098126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.098400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.099160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] RBAC: Adding query filter params (role.id=c85ea3ef4c554385b91a4692fc8b791a, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=a78694291dba47f1b833c721cb728460) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:54.099471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:54.100896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:54.102451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 549/1065] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:54.102953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:54.107487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 517/1066] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/role_assignments?user.id=a78694291dba47f1b833c721cb728460&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=c85ea3ef4c554385b91a4692fc8b791a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:54.385674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c08eec-cc80-4651-8ee1-b23ce5eefd18 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:54.492714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c08eec-cc80-4651-8ee1-b23ce5eefd18 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:54.528371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:54.529015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.529302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.529580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.540257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:54.545011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:54.546026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:54.547132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 550/1067] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:54.552827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:54.668413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab536b10-7b51-4801-8b2d-4aca698be4b3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:54.734045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:54.735129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.735634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.737103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.738992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:54.739533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:54.741826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:54.763635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 518/1068] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:54.764971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:54.819443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:54.876067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf5fd7-c736-4d50-a382-15ba4bbb1d30 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:54.919482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:54.920194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.920578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.921007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] PATH_INFO: `/v3/users/8cc27cbf2e54427390723fe139804cf1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.922423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] RBAC: Authorizing `identity:get_user(user_id=8cc27cbf2e54427390723fe139804cf1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:54.924210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:54.925965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 551/1069] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:01:54 2022] GET /identity/v3/users/8cc27cbf2e54427390723fe139804cf1 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:54.933309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:55.014593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:55.065765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b67f4-2ec4-4484-9c8c-fc5a4b931080 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:55.106164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097b022-9e1c-463f-9609-6ca2b83844b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:55.106837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b022-9e1c-463f-9609-6ca2b83844b6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:55.107125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b022-9e1c-463f-9609-6ca2b83844b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:55.107405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b022-9e1c-463f-9609-6ca2b83844b6 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:55.108548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097b022-9e1c-463f-9609-6ca2b83844b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0ac2791fbf426fbdb89ef5486d3f36)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:55.110053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097b022-9e1c-463f-9609-6ca2b83844b6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:55.112512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 519/1070] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:01:54 2022] GET /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:55.118566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:55.227407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6ba1d-d9d3-43fd-9a99-ecc6b240ed3f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:55.247631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:55.268377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31aa42-5537-4bb6-8015-88ddd8fc9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:55.268754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31aa42-5537-4bb6-8015-88ddd8fc9361 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:55.269035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31aa42-5537-4bb6-8015-88ddd8fc9361 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:55.269319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31aa42-5537-4bb6-8015-88ddd8fc9361 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36/users/8cc27cbf2e54427390723fe139804cf1/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:55.271460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31aa42-5537-4bb6-8015-88ddd8fc9361 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c0ac2791fbf426fbdb89ef5486d3f36, user_id=8cc27cbf2e54427390723fe139804cf1, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:55.272964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31aa42-5537-4bb6-8015-88ddd8fc9361 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:55.354164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 552/1071] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:55 2022] PUT /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36/users/8cc27cbf2e54427390723fe139804cf1/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:56.117269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d7087-f18d-46c5-8120-8551071449bb None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.117830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d7087-f18d-46c5-8120-8551071449bb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.117830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d7087-f18d-46c5-8120-8551071449bb None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.119192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 520/1072] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:56.124595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f4b8-ef41-4ea0-81e9-e059ff4cc67c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.125060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f4b8-ef41-4ea0-81e9-e059ff4cc67c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.125221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f4b8-ef41-4ea0-81e9-e059ff4cc67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.144633 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1b72f4b8-ef41-4ea0-81e9-e059ff4cc67c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:56.145978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1b72f4b8-ef41-4ea0-81e9-e059ff4cc67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:56.218086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 553/1073] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:56.491816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d7087-f18d-46c5-8120-8551071449bb None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:56.605386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d7087-f18d-46c5-8120-8551071449bb None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:56.634981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:56.645651 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:56.646295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.649709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.649709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.659100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:56.663860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:56.664970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:56.665851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:56.672419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 521/1074] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:56.672601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72f4b8-ef41-4ea0-81e9-e059ff4cc67c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:56.786115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72f4b8-ef41-4ea0-81e9-e059ff4cc67c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:56.798087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:56.839454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:56.840425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.840871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.841306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.842421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:56.842946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:56.845364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:56.867047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 554/1075] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:56.869417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.038219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1da11-8d66-4bbd-aff5-aee993f30291 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.089558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.090357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.090790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.091171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.103827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.105518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:57.122082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:57.123978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:57.125049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:57.125049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:57.125049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:57.125049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 522/1076] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:57.129451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.236938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfb9ca-a847-42ed-9f6b-51e22d6076ba None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.273016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e8b5a-aed4-4f3b-8591-4f589556d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.273627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e8b5a-aed4-4f3b-8591-4f589556d22a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.273907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e8b5a-aed4-4f3b-8591-4f589556d22a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.274179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e8b5a-aed4-4f3b-8591-4f589556d22a None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.274853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e8b5a-aed4-4f3b-8591-4f589556d22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:57.275158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e8b5a-aed4-4f3b-8591-4f589556d22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.276535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e8b5a-aed4-4f3b-8591-4f589556d22a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.289795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 555/1077] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:57.295459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.342846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:57.411946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3e64-63d1-4ea1-b220-3368ec9360bf None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.424085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd1de3-12e2-4b03-b731-caa77d1a9296 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.424862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd1de3-12e2-4b03-b731-caa77d1a9296 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.425411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd1de3-12e2-4b03-b731-caa77d1a9296 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.428042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 556/1078] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:01:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:57.433725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc691960-3ce5-4b83-813e-442b9213cf0d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.434074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc691960-3ce5-4b83-813e-442b9213cf0d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.434357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc691960-3ce5-4b83-813e-442b9213cf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.448524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.449166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.449444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.449714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.455863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fc691960-3ce5-4b83-813e-442b9213cf0d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:57.457093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fc691960-3ce5-4b83-813e-442b9213cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:57.459061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.460508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:57.473851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:57.475067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:57.476184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 523/1079] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:57.480825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.488824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:57.537521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 557/1080] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:57.649941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:57.654948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5236d-9e8b-4f18-86f8-2e1cae94428e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.712049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.713277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.713770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.714259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.715674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:57.716246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.719090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.757126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 524/1081] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:57.759093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc691960-3ce5-4b83-813e-442b9213cf0d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.813909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.886758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc691960-3ce5-4b83-813e-442b9213cf0d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.940498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.941413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.941871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.942314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.959052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.961477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.964171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ec0c-7d16-4cab-ab5d-fafc6a9d8cca None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:57.985606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:57.987012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:57.987900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:57.987900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:57.987900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:57.988445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 558/1082] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:57.994503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.014743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.019444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.020139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.020469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.020876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.032496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:58.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:58.042622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:01:58.043537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 525/1083] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:58.045153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.066121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.117313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f782-c4b1-4f01-afe0-131db49b2734 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.155574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.156269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.156472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.156751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.157409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:58.157718 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.160090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.173116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 559/1084] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:58.180233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.187306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7ef7-71c4-4f6c-a9ca-12d310e68827 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.234727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.235230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.235504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.235792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.236732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:58.237066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.238682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.248427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 526/1085] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:58.255139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.269662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.310027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a12c8-186b-4fa1-b69c-efc6c3d77fe6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.355290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.355510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.356066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.356359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.356636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.366423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.368992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.386124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028a58-f1eb-4312-9991-30be1e8da7af None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:58.389248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:58.390526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:01:58.392063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 560/1086] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:58.397334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.431425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.432065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.432351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.432629 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] PATH_INFO: `/v3/users/8cc27cbf2e54427390723fe139804cf1` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.433790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] RBAC: Authorizing `identity:get_user(user_id=8cc27cbf2e54427390723fe139804cf1)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.435290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.436919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 527/1087] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/users/8cc27cbf2e54427390723fe139804cf1 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:58.445486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.535746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61a77-450b-41bd-9c37-8a8608ab44f6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.567960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.573013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.573635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.573916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.574190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.574923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:58.575227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.576729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.591084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875835b2-243c-4b35-87d0-4cff82f54e90 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.591288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 561/1088] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:58.598578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.634752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.635376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.635666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.635943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.660436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.730645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76e24a-98d3-4d9b-b449-2ca8e8e122dd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.737128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.738748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.771224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.771896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.772181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.772459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/a78694291dba47f1b833c721cb728460/roles/c85ea3ef4c554385b91a4692fc8b791a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.774776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=a78694291dba47f1b833c721cb728460, role_id=c85ea3ef4c554385b91a4692fc8b791a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.776235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.848636 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 528/1089] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:01:58.854879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.859841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 562/1090] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:58 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/a78694291dba47f1b833c721cb728460/roles/c85ea3ef4c554385b91a4692fc8b791a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:01:58.918222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.983294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce367f-db7b-45b3-9b74-ef15a945f24e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.027584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c01ac-72b9-4e1e-baa2-573669893c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.028613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c01ac-72b9-4e1e-baa2-573669893c81 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.029096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c01ac-72b9-4e1e-baa2-573669893c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.029556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c01ac-72b9-4e1e-baa2-573669893c81 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.031519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c01ac-72b9-4e1e-baa2-573669893c81 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0ac2791fbf426fbdb89ef5486d3f36)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.034758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c01ac-72b9-4e1e-baa2-573669893c81 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.037919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 529/1091] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:59.045703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:59.139527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:59.194387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68504-51ef-45b5-806d-448603d4120e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.234800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d6662-997e-4e44-8600-30b479e960f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.235418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6662-997e-4e44-8600-30b479e960f5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.235701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6662-997e-4e44-8600-30b479e960f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.235979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6662-997e-4e44-8600-30b479e960f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.236773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d6662-997e-4e44-8600-30b479e960f5 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36, user.id=8cc27cbf2e54427390723fe139804cf1) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:59.237080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d6662-997e-4e44-8600-30b479e960f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.238529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d6662-997e-4e44-8600-30b479e960f5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.254667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 563/1092] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:59 2022] GET /identity/v3/role_assignments?user.id=8cc27cbf2e54427390723fe139804cf1&scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:00.836468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc079d5-3af6-4761-a2ac-d7db18f63b5c None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.837034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc079d5-3af6-4761-a2ac-d7db18f63b5c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.837359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc079d5-3af6-4761-a2ac-d7db18f63b5c None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.839746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 530/1093] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:00.848040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85643-981e-4b2d-bedb-fa501f4e4440 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.848632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85643-981e-4b2d-bedb-fa501f4e4440 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.848632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85643-981e-4b2d-bedb-fa501f4e4440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.868458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-84a85643-981e-4b2d-bedb-fa501f4e4440 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:00.869668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-84a85643-981e-4b2d-bedb-fa501f4e4440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:00.949960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 564/1094] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:01.220337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc079d5-3af6-4761-a2ac-d7db18f63b5c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.266820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb0ed7-0e05-4feb-afcd-09404b2c93a6 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.267397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb0ed7-0e05-4feb-afcd-09404b2c93a6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.267675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb0ed7-0e05-4feb-afcd-09404b2c93a6 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.269094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 565/1095] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:02:01.274915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6661bd3-7f2a-46e2-916c-e14502ac0957 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.275209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6661bd3-7f2a-46e2-916c-e14502ac0957 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.275485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6661bd3-7f2a-46e2-916c-e14502ac0957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.294492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f6661bd3-7f2a-46e2-916c-e14502ac0957 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:01.295750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f6661bd3-7f2a-46e2-916c-e14502ac0957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:01.343803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:01.350447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc079d5-3af6-4761-a2ac-d7db18f63b5c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:01.369083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:01.374149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 566/1096] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:02:01.388248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:01.388919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.389206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.389484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.400145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:01.405270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:01.406210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:01.407702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 531/1097] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 17 20:02:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:01.412909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6661bd3-7f2a-46e2-916c-e14502ac0957 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.526522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6661bd3-7f2a-46e2-916c-e14502ac0957 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:01.565256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:01.565882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.566165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.566439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.567171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:01.567478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:01.568942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:01.578099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 567/1098] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 17 20:02:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:01.584923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.656058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.699638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a33968-4d4a-4cc7-a810-6d2f47763347 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:01.710953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:01.749676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:01.750472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.750850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.751279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.763727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:01.765170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:01.781831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:01.783970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:02:01.785078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:01.785078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:01.785078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:01.785078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 532/1099] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:01.789105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4ef7-dad7-4871-bb9c-df03abcaef90 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:01.789636 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.823284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:01.841076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:01.842113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.842620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.843196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.846538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:01.849484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:01.852672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 568/1100] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:01.858926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.904476 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6310-1f0d-4195-a8a2-1cce032ed3e3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:01.939349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:01.939958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.940245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.940525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.941169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:01.941475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:01.942876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:01.954587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 533/1101] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:01.960958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.002227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6fc4e-494c-43e4-ae3b-3628da9ea508 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.009487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:02.038415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.038967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.039357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.039634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.040413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.042259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:02.053100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:02.065261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873b51f-8f0e-4a47-b2b2-d3139a91b202 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.101887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.102580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.102926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.103331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.110587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.112243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:02:02.123790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:02.125576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:02.127889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 534/1102] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 17 20:02:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:02.131099 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.173757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 569/1103] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:02:01 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:02.248066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ecb1b-f2b4-4d40-87f8-9525ca34787b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.294386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.294940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.295221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.295495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.296259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:02.296560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.298057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:02.326671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 535/1104] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:02.333812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.456519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b4bf-079d-4047-9f48-2e07ea41ec7a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.495545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.496161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.496441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.496720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.532020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:02.576578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.577982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:02.698842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 570/1105] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:02.704973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.714692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:02.825722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170d91-e25d-4eb0-9dce-df3fd851a452 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.862112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.862832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.863297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.863700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.875801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.877470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:02.894249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:02.896308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:02:02.898196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:02.898196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:02.898196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:02.898196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 536/1106] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:02.901431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.968005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.011693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76226f42-1f49-49c6-886b-454a08b5911e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.048847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.049461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.049735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.050010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.050720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:03.050987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.052336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.070423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 571/1107] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:03.072184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.148823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.197287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a5ef-1e2d-4b8e-8e37-f8ce9d7c977b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.236811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.237983 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.238267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.238535 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.248100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.250211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:02:03.263648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:03.264648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:03.265668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 537/1108] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:03.272327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.401230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712389b-db93-4e71-8956-a6b4db4fe059 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.427912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.443601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ffdc6-461d-44dc-bd73-a6f8bb2164bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.445869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ffdc6-461d-44dc-bd73-a6f8bb2164bf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.445869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ffdc6-461d-44dc-bd73-a6f8bb2164bf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.445869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ffdc6-461d-44dc-bd73-a6f8bb2164bf None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.446280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ffdc6-461d-44dc-bd73-a6f8bb2164bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:03.446420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ffdc6-461d-44dc-bd73-a6f8bb2164bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.448206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ffdc6-461d-44dc-bd73-a6f8bb2164bf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.474559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 572/1109] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:03.476278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.604825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1628bcd-8f73-4a16-bf4d-8d5b72fcc0d9 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.630960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.652283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71445efc-d2c4-4c1c-a35e-3e4741e55f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.652832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71445efc-d2c4-4c1c-a35e-3e4741e55f29 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.653113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71445efc-d2c4-4c1c-a35e-3e4741e55f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.653387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71445efc-d2c4-4c1c-a35e-3e4741e55f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.654167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71445efc-d2c4-4c1c-a35e-3e4741e55f29 None admin] RBAC: Adding query filter params (role.id=c85ea3ef4c554385b91a4692fc8b791a, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=a78694291dba47f1b833c721cb728460) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:03.654478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71445efc-d2c4-4c1c-a35e-3e4741e55f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.656033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71445efc-d2c4-4c1c-a35e-3e4741e55f29 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.663305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 538/1110] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/role_assignments?user.id=a78694291dba47f1b833c721cb728460&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=c85ea3ef4c554385b91a4692fc8b791a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:04.208760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c0be6-f9ad-4a45-9340-83b42cde01f7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.209294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c0be6-f9ad-4a45-9340-83b42cde01f7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.209637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c0be6-f9ad-4a45-9340-83b42cde01f7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.211202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 573/1111] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:04.217466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f171-b2f8-433c-ab90-15d5396773e7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.217952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f171-b2f8-433c-ab90-15d5396773e7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.218063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f171-b2f8-433c-ab90-15d5396773e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.237791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0246f171-b2f8-433c-ab90-15d5396773e7 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:04.239049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0246f171-b2f8-433c-ab90-15d5396773e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:04.318584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 539/1112] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:04.592086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c0be6-f9ad-4a45-9340-83b42cde01f7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.708636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c0be6-f9ad-4a45-9340-83b42cde01f7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.744833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.745475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.745760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.746034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] PATH_INFO: `/v3/roles/341040ab922c4a298485eb1262890305` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.747491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] RBAC: Authorizing `identity:get_role(role_id=341040ab922c4a298485eb1262890305)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.748933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.750285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 574/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/roles/341040ab922c4a298485eb1262890305 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:04.756988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f171-b2f8-433c-ab90-15d5396773e7 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.883213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f171-b2f8-433c-ab90-15d5396773e7 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.899322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.926432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.927178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.927517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.927841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] PATH_INFO: `/v3/users/de5016b5fbb7419596988633b6018285` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.944864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] RBAC: Authorizing `identity:get_user(user_id=de5016b5fbb7419596988633b6018285)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.946457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.948291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 540/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/users/de5016b5fbb7419596988633b6018285 => generated 286 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:04.954264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:05.009636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:05.066398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8878f8-7364-4f20-8160-6d9b6bd21b75 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:05.104695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:05.105321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:05.105608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:05.105888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:05.180189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:05.181549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:05.231794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:05.284221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 575/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:05.290394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:05.398060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624466c-deb1-40ba-986b-30b975e6c238 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:05.432937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702adc2-cb23-4e11-bf5b-ce94a8252c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:05.433482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702adc2-cb23-4e11-bf5b-ce94a8252c09 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:05.433762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702adc2-cb23-4e11-bf5b-ce94a8252c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:05.434036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702adc2-cb23-4e11-bf5b-ce94a8252c09 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:05.435220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702adc2-cb23-4e11-bf5b-ce94a8252c09 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0ac2791fbf426fbdb89ef5486d3f36)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:05.436666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702adc2-cb23-4e11-bf5b-ce94a8252c09 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:05.438500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 541/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:05 2022] GET /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:05.446027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:05.558099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51519b1c-7f20-4ebc-8983-31c0077fe637 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:05.595669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f023e45-2c8a-4bd1-9e9d-707ca91a3689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:05.596290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023e45-2c8a-4bd1-9e9d-707ca91a3689 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:05.596573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023e45-2c8a-4bd1-9e9d-707ca91a3689 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:05.596857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023e45-2c8a-4bd1-9e9d-707ca91a3689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:05.597596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f023e45-2c8a-4bd1-9e9d-707ca91a3689 None admin] RBAC: Adding query filter params (role.id=341040ab922c4a298485eb1262890305, scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36, user.id=de5016b5fbb7419596988633b6018285) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:05.597910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f023e45-2c8a-4bd1-9e9d-707ca91a3689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:05.599371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f023e45-2c8a-4bd1-9e9d-707ca91a3689 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:05.605240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 576/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:05 2022] GET /identity/v3/role_assignments?user.id=de5016b5fbb7419596988633b6018285&scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36&role.id=341040ab922c4a298485eb1262890305 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:07.534086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0306-80e2-4620-84cf-74890b138b6f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:07.534618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0306-80e2-4620-84cf-74890b138b6f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:07.534618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0306-80e2-4620-84cf-74890b138b6f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:07.536009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 542/1118] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:07.541173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1100-f3aa-4320-9b1b-f478daf18757 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:07.541571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1100-f3aa-4320-9b1b-f478daf18757 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:07.541722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1100-f3aa-4320-9b1b-f478daf18757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:07.559762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-17bf1100-f3aa-4320-9b1b-f478daf18757 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:07.560940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-17bf1100-f3aa-4320-9b1b-f478daf18757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:07.570899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:07.627352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 577/1119] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:07.897682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0306-80e2-4620-84cf-74890b138b6f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:07.939547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.002115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0306-80e2-4620-84cf-74890b138b6f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.038185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.038849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.039133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.039407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] PATH_INFO: `/v3/roles/341040ab922c4a298485eb1262890305` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.040803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] RBAC: Authorizing `identity:get_role(role_id=341040ab922c4a298485eb1262890305)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.042171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.043550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 543/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:07 2022] GET /identity/v3/roles/341040ab922c4a298485eb1262890305 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:08.049890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1100-f3aa-4320-9b1b-f478daf18757 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.151333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1100-f3aa-4320-9b1b-f478daf18757 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.186025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.186688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.186971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.187244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] PATH_INFO: `/v3/users/de5016b5fbb7419596988633b6018285` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.188368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] RBAC: Authorizing `identity:get_user(user_id=de5016b5fbb7419596988633b6018285)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.190147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.191777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 578/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/users/de5016b5fbb7419596988633b6018285 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:08.197673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.301812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0414a54-34e9-4ec1-be65-b6d9d829242f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.309388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.337744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210846d-2d2e-4f26-af55-141860af8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.338374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210846d-2d2e-4f26-af55-141860af8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.338671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210846d-2d2e-4f26-af55-141860af8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.338950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210846d-2d2e-4f26-af55-141860af8ee9 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.340074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210846d-2d2e-4f26-af55-141860af8ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0ac2791fbf426fbdb89ef5486d3f36)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.341490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210846d-2d2e-4f26-af55-141860af8ee9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.343530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 544/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:08.350371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.366348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.455884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a7e4-455f-4970-a6ad-73f643afd432 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.491935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae8b1-722f-4f05-88b4-b33649e00454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.492612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae8b1-722f-4f05-88b4-b33649e00454 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.492898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae8b1-722f-4f05-88b4-b33649e00454 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.493178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae8b1-722f-4f05-88b4-b33649e00454 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36/users/de5016b5fbb7419596988633b6018285/roles/341040ab922c4a298485eb1262890305` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.495444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae8b1-722f-4f05-88b4-b33649e00454 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c0ac2791fbf426fbdb89ef5486d3f36, user_id=de5016b5fbb7419596988633b6018285, role_id=341040ab922c4a298485eb1262890305)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.496888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae8b1-722f-4f05-88b4-b33649e00454 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.556417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 579/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:08 2022] PUT /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36/users/de5016b5fbb7419596988633b6018285/roles/341040ab922c4a298485eb1262890305 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:02:10.493826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f53046-da10-4683-9e7d-edd983a8104f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:10.494359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f53046-da10-4683-9e7d-edd983a8104f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:10.494359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f53046-da10-4683-9e7d-edd983a8104f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:10.495796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 545/1124] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:10.502055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552a43-3386-41f3-89c9-b34a93d8a6cd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:10.502523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552a43-3386-41f3-89c9-b34a93d8a6cd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:10.502818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552a43-3386-41f3-89c9-b34a93d8a6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:10.520970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b9552a43-3386-41f3-89c9-b34a93d8a6cd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:10.522192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b9552a43-3386-41f3-89c9-b34a93d8a6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:10.591091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 580/1125] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:10.862302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f53046-da10-4683-9e7d-edd983a8104f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:10.961708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f53046-da10-4683-9e7d-edd983a8104f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:10.994886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:10.995501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:10.995779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:10.996054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] PATH_INFO: `/v3/roles/341040ab922c4a298485eb1262890305` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:10.997415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] RBAC: Authorizing `identity:get_role(role_id=341040ab922c4a298485eb1262890305)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:10.998784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:11.000088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 546/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:10 2022] GET /identity/v3/roles/341040ab922c4a298485eb1262890305 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:11.006275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552a43-3386-41f3-89c9-b34a93d8a6cd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:11.008492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:11.104408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552a43-3386-41f3-89c9-b34a93d8a6cd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:11.138281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:11.138857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:11.139144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:11.139421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] PATH_INFO: `/v3/users/de5016b5fbb7419596988633b6018285` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:11.140546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] RBAC: Authorizing `identity:get_user(user_id=de5016b5fbb7419596988633b6018285)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:11.142594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:11.144284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 581/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:11 2022] GET /identity/v3/users/de5016b5fbb7419596988633b6018285 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:11.150202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:11.194344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:11.251721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0910205-dc94-4fea-a751-de51c52f972b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:11.286075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:11.286706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:11.286991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:11.287269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:11.355840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:11.357275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:11.397607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:11.453179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 547/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:11.460020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:11.527845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:11.556913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d015af-7d72-4a8f-933d-4e3c239366a3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:11.590503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7fa9b-f6a8-4601-a302-607af0fc19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:11.591151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fa9b-f6a8-4601-a302-607af0fc19c1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:11.591429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fa9b-f6a8-4601-a302-607af0fc19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:11.591699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fa9b-f6a8-4601-a302-607af0fc19c1 None admin] PATH_INFO: `/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:11.592803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7fa9b-f6a8-4601-a302-607af0fc19c1 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0ac2791fbf426fbdb89ef5486d3f36)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:11.594217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7fa9b-f6a8-4601-a302-607af0fc19c1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:11.595997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 582/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:11 2022] GET /identity/v3/projects/9c0ac2791fbf426fbdb89ef5486d3f36 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:11.602292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:11.700638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daaf61-5e3d-49fb-9a06-b740fa671c42 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:11.733843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881461f-2063-44cd-82d5-05e279d297d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:11.734442 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881461f-2063-44cd-82d5-05e279d297d3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:11.734755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881461f-2063-44cd-82d5-05e279d297d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:11.735035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881461f-2063-44cd-82d5-05e279d297d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:11.736402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881461f-2063-44cd-82d5-05e279d297d3 None admin] RBAC: Adding query filter params (role.id=341040ab922c4a298485eb1262890305, scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36, user.id=de5016b5fbb7419596988633b6018285) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:11.736714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881461f-2063-44cd-82d5-05e279d297d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:11.738124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881461f-2063-44cd-82d5-05e279d297d3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:11.743885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 548/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:11 2022] GET /identity/v3/role_assignments?user.id=de5016b5fbb7419596988633b6018285&scope.project.id=9c0ac2791fbf426fbdb89ef5486d3f36&role.id=341040ab922c4a298485eb1262890305 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:13.666114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d2a1-9ab1-4118-b1b0-3375b90c8b27 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:13.666707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d2a1-9ab1-4118-b1b0-3375b90c8b27 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:13.666707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d2a1-9ab1-4118-b1b0-3375b90c8b27 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:13.668031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 583/1131] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:13.673283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bcf2-c526-4ef7-91bd-610341b5e3c0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:13.673716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bcf2-c526-4ef7-91bd-610341b5e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:13.674116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bcf2-c526-4ef7-91bd-610341b5e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:13.686945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:13.692858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4b35bcf2-c526-4ef7-91bd-610341b5e3c0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:13.694049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4b35bcf2-c526-4ef7-91bd-610341b5e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:13.760678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 549/1132] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:14.029536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d2a1-9ab1-4118-b1b0-3375b90c8b27 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:14.129798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d2a1-9ab1-4118-b1b0-3375b90c8b27 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:14.162769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6329cab-5e1e-4e55-ae26-1cb631f62d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:14.163400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6329cab-5e1e-4e55-ae26-1cb631f62d11 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:14.163685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6329cab-5e1e-4e55-ae26-1cb631f62d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:14.163960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6329cab-5e1e-4e55-ae26-1cb631f62d11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:14.165065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6329cab-5e1e-4e55-ae26-1cb631f62d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:14.166487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6329cab-5e1e-4e55-ae26-1cb631f62d11 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:14.168095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 584/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:14.174526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35bcf2-c526-4ef7-91bd-610341b5e3c0 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:14.271452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35bcf2-c526-4ef7-91bd-610341b5e3c0 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:14.306151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c005-b4ee-4d51-8dd1-f2037982f968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:14.306710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c005-b4ee-4d51-8dd1-f2037982f968 None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:14.306993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c005-b4ee-4d51-8dd1-f2037982f968 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:14.307270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c005-b4ee-4d51-8dd1-f2037982f968 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:14.307927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c005-b4ee-4d51-8dd1-f2037982f968 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:14.309349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c005-b4ee-4d51-8dd1-f2037982f968 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:14.314832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:14.409651 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 550/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:02:14 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:16.364769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4188-5a1e-44da-944e-31c2858f8aad None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:16.365301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4188-5a1e-44da-944e-31c2858f8aad None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:16.365301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4188-5a1e-44da-944e-31c2858f8aad None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:16.366682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 585/1135] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:16.371953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb2de-dd18-472e-8c5b-69b3b3218149 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:16.372463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb2de-dd18-472e-8c5b-69b3b3218149 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:16.372558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb2de-dd18-472e-8c5b-69b3b3218149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:16.390391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a2acb2de-dd18-472e-8c5b-69b3b3218149 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:16.392081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a2acb2de-dd18-472e-8c5b-69b3b3218149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:16.458861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 551/1136] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:02:16.728968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4188-5a1e-44da-944e-31c2858f8aad None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:16.738101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:16.828710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4188-5a1e-44da-944e-31c2858f8aad None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:16.862554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8cd7c-1318-4226-9f09-5d5cddfea178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:16.863206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8cd7c-1318-4226-9f09-5d5cddfea178 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:16.863488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8cd7c-1318-4226-9f09-5d5cddfea178 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:16.863762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8cd7c-1318-4226-9f09-5d5cddfea178 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:16.864871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8cd7c-1318-4226-9f09-5d5cddfea178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:16.866292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8cd7c-1318-4226-9f09-5d5cddfea178 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:16.867894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 586/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:16.873913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb2de-dd18-472e-8c5b-69b3b3218149 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:16.971796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb2de-dd18-472e-8c5b-69b3b3218149 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:16.988910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:17.005607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574334c8-d0df-4b5d-ae55-58327da860aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:17.006210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574334c8-d0df-4b5d-ae55-58327da860aa None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:17.006490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574334c8-d0df-4b5d-ae55-58327da860aa None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:17.006801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574334c8-d0df-4b5d-ae55-58327da860aa None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:17.007448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574334c8-d0df-4b5d-ae55-58327da860aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:17.008872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574334c8-d0df-4b5d-ae55-58327da860aa None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:17.131348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 552/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:02:16 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:19.116447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83bba-1f77-4860-98db-88a03e93d020 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:19.117011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83bba-1f77-4860-98db-88a03e93d020 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:19.117011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83bba-1f77-4860-98db-88a03e93d020 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:19.118357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 587/1139] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:19.124072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba107ac-1842-4740-bd14-99adcc1ac3be None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:19.124600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba107ac-1842-4740-bd14-99adcc1ac3be None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:19.124702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba107ac-1842-4740-bd14-99adcc1ac3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:19.143869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bba107ac-1842-4740-bd14-99adcc1ac3be None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:19.145081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bba107ac-1842-4740-bd14-99adcc1ac3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:19.212711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 553/1140] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:19.486858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da83bba-1f77-4860-98db-88a03e93d020 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:19.560811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:19.587194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da83bba-1f77-4860-98db-88a03e93d020 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:19.621022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:19.621655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:19.621937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:19.622213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:19.632623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:19.637297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:19.638367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:02:19.639256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 588/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:19.645621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba107ac-1842-4740-bd14-99adcc1ac3be None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:19.743364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba107ac-1842-4740-bd14-99adcc1ac3be None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:19.745512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:19.776105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:19.776991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:19.777273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:19.777550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:19.778208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:19.778514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:19.779915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:19.788603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 554/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:19.794378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:19.893260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430b78-8de7-4dcf-88a0-1201b2652afc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:19.926428 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:19.927086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:19.927368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:19.927644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] PATH_INFO: `/v3/users/87222402e39c4092b2238cdf5b9996ec` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:19.929514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:19.941214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] RBAC: Authorizing `identity:get_user(user_id=87222402e39c4092b2238cdf5b9996ec)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:19.942832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:19.944469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 589/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:19 2022] GET /identity/v3/users/87222402e39c4092b2238cdf5b9996ec => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:19.950515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:20.051761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb11746-f0d3-4b16-9399-9ec99893833b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:20.086563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:20.087208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:20.087490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:20.087762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:20.121101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:20.155749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:20.157831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:20.254409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 555/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:20.262110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:20.365353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae62214-58bc-408a-95ec-5c1f3d974f7b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:20.398335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10bf83-b0b7-439d-b830-6d94542c0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:20.398985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10bf83-b0b7-439d-b830-6d94542c0821 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:20.399272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10bf83-b0b7-439d-b830-6d94542c0821 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:20.399554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10bf83-b0b7-439d-b830-6d94542c0821 None admin] PATH_INFO: `/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:20.400700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10bf83-b0b7-439d-b830-6d94542c0821 None admin] RBAC: Authorizing `identity:get_project(project_id=5e70bba2b33e45b4bd7bb30e5977a208)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:20.402379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10bf83-b0b7-439d-b830-6d94542c0821 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:20.404045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 590/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:20 2022] GET /identity/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:20.410886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:20.475367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:20.510131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54248f88-6ec2-4f3f-a4d9-35c7fa723599 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:20.544522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d76b86-187c-4002-97e3-b55619c344df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:20.545154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76b86-187c-4002-97e3-b55619c344df None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:20.545437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76b86-187c-4002-97e3-b55619c344df None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:20.545716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76b86-187c-4002-97e3-b55619c344df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:20.546439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d76b86-187c-4002-97e3-b55619c344df None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=5e70bba2b33e45b4bd7bb30e5977a208, user.id=87222402e39c4092b2238cdf5b9996ec) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:20.546785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d76b86-187c-4002-97e3-b55619c344df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:20.548783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d76b86-187c-4002-97e3-b55619c344df None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:20.554174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 556/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:20 2022] GET /identity/v3/role_assignments?user.id=87222402e39c4092b2238cdf5b9996ec&scope.project.id=5e70bba2b33e45b4bd7bb30e5977a208&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:22.532985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669986d3-abe4-4b27-a2ce-38d22fbe657c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:22.533583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669986d3-abe4-4b27-a2ce-38d22fbe657c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:22.533583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669986d3-abe4-4b27-a2ce-38d22fbe657c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:22.534975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 591/1147] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:22.540246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669bf0-58ad-4408-b9a0-fa7cbb2b2dfb None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:22.540683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669bf0-58ad-4408-b9a0-fa7cbb2b2dfb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:22.540785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669bf0-58ad-4408-b9a0-fa7cbb2b2dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:22.559087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-fd669bf0-58ad-4408-b9a0-fa7cbb2b2dfb None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:22.560304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fd669bf0-58ad-4408-b9a0-fa7cbb2b2dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:22.627863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 557/1148] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:22.901810 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669986d3-abe4-4b27-a2ce-38d22fbe657c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:22.961904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:23.003136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669986d3-abe4-4b27-a2ce-38d22fbe657c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:23.036503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:23.037140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:23.037425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:23.037703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:23.048239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:23.052929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:23.054083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:02:23.055051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 592/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:23.060086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669bf0-58ad-4408-b9a0-fa7cbb2b2dfb None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:23.117865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:23.159142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669bf0-58ad-4408-b9a0-fa7cbb2b2dfb None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:23.193780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:23.194384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:23.194691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:23.194971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:23.195629 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:23.195932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:23.197298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:23.206205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 558/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:23.212170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:23.314736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7598-8d43-456d-990d-2af4b707e0d0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:23.333993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:23.348827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:23.349456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:23.349735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:23.350006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] PATH_INFO: `/v3/users/87222402e39c4092b2238cdf5b9996ec` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:23.351147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] RBAC: Authorizing `identity:get_user(user_id=87222402e39c4092b2238cdf5b9996ec)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:23.352568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:23.354165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 593/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:23 2022] GET /identity/v3/users/87222402e39c4092b2238cdf5b9996ec => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:23.359974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:23.457148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86f601-8a74-4229-a052-b4ca17ef5df4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:23.480053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:23.491853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd76e7-5427-4d83-aa60-6ffb68dc52da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:23.492474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd76e7-5427-4d83-aa60-6ffb68dc52da None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:23.492755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd76e7-5427-4d83-aa60-6ffb68dc52da None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:23.493031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd76e7-5427-4d83-aa60-6ffb68dc52da None admin] PATH_INFO: `/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:23.494134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd76e7-5427-4d83-aa60-6ffb68dc52da None admin] RBAC: Authorizing `identity:get_project(project_id=5e70bba2b33e45b4bd7bb30e5977a208)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:23.495579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd76e7-5427-4d83-aa60-6ffb68dc52da None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:23.497197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 559/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:23 2022] GET /identity/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:23.504456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:23.609778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba867f9-b4ee-4885-9cd1-53facc37ed4f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:23.643989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6d805-1792-402a-97a8-02a8ed9a4cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:23.644642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d805-1792-402a-97a8-02a8ed9a4cd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:23.644929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d805-1792-402a-97a8-02a8ed9a4cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:23.645203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d805-1792-402a-97a8-02a8ed9a4cd3 None admin] PATH_INFO: `/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208/users/87222402e39c4092b2238cdf5b9996ec/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:23.647116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6d805-1792-402a-97a8-02a8ed9a4cd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e70bba2b33e45b4bd7bb30e5977a208, user_id=87222402e39c4092b2238cdf5b9996ec, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:23.648536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6d805-1792-402a-97a8-02a8ed9a4cd3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:23.727954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 594/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:23 2022] PUT /identity/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208/users/87222402e39c4092b2238cdf5b9996ec/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:02:25.635602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ca19-3c78-480e-8ce6-d8a4f727a58c None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:25.636150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ca19-3c78-480e-8ce6-d8a4f727a58c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:25.636150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ca19-3c78-480e-8ce6-d8a4f727a58c None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:25.637491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 560/1154] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:25.642863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650267c5-377f-40ed-982c-b5dd7b45de3d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:25.643291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650267c5-377f-40ed-982c-b5dd7b45de3d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:25.643429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650267c5-377f-40ed-982c-b5dd7b45de3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:25.662202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-650267c5-377f-40ed-982c-b5dd7b45de3d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:25.663419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-650267c5-377f-40ed-982c-b5dd7b45de3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:25.706347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:25.729415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 595/1155] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:26.002805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2ca19-3c78-480e-8ce6-d8a4f727a58c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:26.105971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2ca19-3c78-480e-8ce6-d8a4f727a58c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:26.138355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:26.139000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:26.139283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:26.139556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:26.149850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:26.154834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:26.155943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:26.157037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 561/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:26.162620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650267c5-377f-40ed-982c-b5dd7b45de3d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:26.259913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650267c5-377f-40ed-982c-b5dd7b45de3d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:26.293730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:26.294338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:26.294655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:26.294932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:26.295600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:26.295906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:26.297280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:26.308510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 596/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:26.314435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:26.365461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:26.415753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398da978-9682-4397-a457-9f8744d3ca6e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:26.449791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:26.450417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:26.450727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:26.451009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] PATH_INFO: `/v3/users/87222402e39c4092b2238cdf5b9996ec` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:26.452143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] RBAC: Authorizing `identity:get_user(user_id=87222402e39c4092b2238cdf5b9996ec)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:26.453569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:26.455372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 562/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:26 2022] GET /identity/v3/users/87222402e39c4092b2238cdf5b9996ec => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:26.461410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:26.504413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:26.564294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bee41-cdab-4b3b-9fa8-7d48e2bac85e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:26.598197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:26.598837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:26.599114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:26.599385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:26.666711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:26.668155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:26.708449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:26.766953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 597/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:26.772873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:26.871527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3d29-0739-4b72-a7d1-182eda6837fa None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:26.889078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:26.906643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd11e-b672-44b4-bc32-dc155e995cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:26.908151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd11e-b672-44b4-bc32-dc155e995cfb None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:26.908490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd11e-b672-44b4-bc32-dc155e995cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:26.908765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd11e-b672-44b4-bc32-dc155e995cfb None admin] PATH_INFO: `/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:26.909923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd11e-b672-44b4-bc32-dc155e995cfb None admin] RBAC: Authorizing `identity:get_project(project_id=5e70bba2b33e45b4bd7bb30e5977a208)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:26.911490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd11e-b672-44b4-bc32-dc155e995cfb None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:26.913118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 563/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:26 2022] GET /identity/v3/projects/5e70bba2b33e45b4bd7bb30e5977a208 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:26.919382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:27.017396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4610996-dbc6-4491-b10d-5cf4ef29da23 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:27.049948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32c269-dbfa-4a43-853d-0440e2231e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:27.050546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c269-dbfa-4a43-853d-0440e2231e62 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:27.050850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c269-dbfa-4a43-853d-0440e2231e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:27.051127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c269-dbfa-4a43-853d-0440e2231e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:27.051843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32c269-dbfa-4a43-853d-0440e2231e62 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=5e70bba2b33e45b4bd7bb30e5977a208, user.id=87222402e39c4092b2238cdf5b9996ec) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:27.052151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32c269-dbfa-4a43-853d-0440e2231e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:27.053568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32c269-dbfa-4a43-853d-0440e2231e62 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:27.059197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 598/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:26 2022] GET /identity/v3/role_assignments?user.id=87222402e39c4092b2238cdf5b9996ec&scope.project.id=5e70bba2b33e45b4bd7bb30e5977a208&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:29.017744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f671b-79ca-4c9b-98d6-754722032911 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.018308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f671b-79ca-4c9b-98d6-754722032911 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.018308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f671b-79ca-4c9b-98d6-754722032911 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:29.019584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 564/1162] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:29.024680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c12115-071f-4593-a3f8-e4a927985310 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.025117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c12115-071f-4593-a3f8-e4a927985310 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.025279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c12115-071f-4593-a3f8-e4a927985310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:29.033726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:29.044267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-19c12115-071f-4593-a3f8-e4a927985310 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:29.052614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-19c12115-071f-4593-a3f8-e4a927985310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:29.112789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 599/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:29.384670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f671b-79ca-4c9b-98d6-754722032911 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:29.486004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f671b-79ca-4c9b-98d6-754722032911 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:29.520272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:29.520875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.521157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.521432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:29.579738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:29.592734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:29.594946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:29.697951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 565/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:29.704660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c12115-071f-4593-a3f8-e4a927985310 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:29.801164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c12115-071f-4593-a3f8-e4a927985310 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:29.834175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad7037-5a11-454e-98ea-96c2cfb0defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:29.834825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7037-5a11-454e-98ea-96c2cfb0defd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.835104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7037-5a11-454e-98ea-96c2cfb0defd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.835373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7037-5a11-454e-98ea-96c2cfb0defd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:29.837256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:29.842353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad7037-5a11-454e-98ea-96c2cfb0defd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:29.843799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad7037-5a11-454e-98ea-96c2cfb0defd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b5ad7037-5a11-454e-98ea-96c2cfb0defd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:29.855634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:29.856866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:02:29.857954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 600/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:02:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:29.863158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:29.946650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:29.961363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711318a3-5673-4ef1-9333-73f9f040f2c5 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:29.995383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bbc86-9079-4e71-a814-43075aa3c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:29.995985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bbc86-9079-4e71-a814-43075aa3c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.996265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bbc86-9079-4e71-a814-43075aa3c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.996540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bbc86-9079-4e71-a814-43075aa3c8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:29.997176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bbc86-9079-4e71-a814-43075aa3c8f7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:29.997479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bbc86-9079-4e71-a814-43075aa3c8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:29.998866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bbc86-9079-4e71-a814-43075aa3c8f7 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:30.006807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 566/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 17 20:02:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:31.964292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87548d0a-2217-4c97-aa92-6a03aaf0b942 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:31.964811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87548d0a-2217-4c97-aa92-6a03aaf0b942 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:31.964811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87548d0a-2217-4c97-aa92-6a03aaf0b942 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:31.966120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 601/1167] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:31.972032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2283e-b2e9-4b14-bc6f-05569cc1455e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:31.972467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2283e-b2e9-4b14-bc6f-05569cc1455e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:31.972591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2283e-b2e9-4b14-bc6f-05569cc1455e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:31.990889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4ed2283e-b2e9-4b14-bc6f-05569cc1455e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:31.992095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4ed2283e-b2e9-4b14-bc6f-05569cc1455e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:32.060358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 567/1168] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:32.338321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87548d0a-2217-4c97-aa92-6a03aaf0b942 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:32.440042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87548d0a-2217-4c97-aa92-6a03aaf0b942 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:32.474178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6f3f7-d09d-40aa-851e-e452fce3a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:32.474809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6f3f7-d09d-40aa-851e-e452fce3a406 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:32.475098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6f3f7-d09d-40aa-851e-e452fce3a406 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:32.475374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6f3f7-d09d-40aa-851e-e452fce3a406 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:32.476044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6f3f7-d09d-40aa-851e-e452fce3a406 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:32.477397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6f3f7-d09d-40aa-851e-e452fce3a406 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:32.568943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 602/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Wed Aug 17 20:02:32 2022] POST /identity/v3/domains => generated 267 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:34.523860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2772ff-e101-4424-bc3a-a3b202246d78 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:34.524418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2772ff-e101-4424-bc3a-a3b202246d78 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:34.524418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2772ff-e101-4424-bc3a-a3b202246d78 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:34.525756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 568/1170] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:34.531227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d11d-9923-4b56-808c-83275ce9d36c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:34.532178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d11d-9923-4b56-808c-83275ce9d36c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:34.532278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d11d-9923-4b56-808c-83275ce9d36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:34.551069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b454d11d-9923-4b56-808c-83275ce9d36c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:34.552308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b454d11d-9923-4b56-808c-83275ce9d36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:34.601761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:34.619632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 603/1171] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:34.894367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2772ff-e101-4424-bc3a-a3b202246d78 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:34.974240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:34.993645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2772ff-e101-4424-bc3a-a3b202246d78 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:35.028170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece3782-2956-438f-8e83-f1efcea61489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:35.028800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3782-2956-438f-8e83-f1efcea61489 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:35.029086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3782-2956-438f-8e83-f1efcea61489 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:35.029368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3782-2956-438f-8e83-f1efcea61489 None admin] PATH_INFO: `/v3/domains/3cdfcb0e3f33439c97171908c740a56a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:35.039795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece3782-2956-438f-8e83-f1efcea61489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3cdfcb0e3f33439c97171908c740a56a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:35.041230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece3782-2956-438f-8e83-f1efcea61489 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:35.042862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 569/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 17 20:02:34 2022] GET /identity/v3/domains/3cdfcb0e3f33439c97171908c740a56a => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:35.049611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d11d-9923-4b56-808c-83275ce9d36c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:35.149315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d11d-9923-4b56-808c-83275ce9d36c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:35.183524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb19bc-9af1-43c2-95a7-7f4644431e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:35.184130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb19bc-9af1-43c2-95a7-7f4644431e24 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:35.184411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb19bc-9af1-43c2-95a7-7f4644431e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:35.184687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb19bc-9af1-43c2-95a7-7f4644431e24 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:35.185327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb19bc-9af1-43c2-95a7-7f4644431e24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:35.186781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb19bc-9af1-43c2-95a7-7f4644431e24 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:35.287367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 604/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:02:35 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:37.222056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe89f-a996-4efe-95b7-22fb5be82f36 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:37.222897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe89f-a996-4efe-95b7-22fb5be82f36 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:37.222897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe89f-a996-4efe-95b7-22fb5be82f36 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:37.224097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 570/1174] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:37.229511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1263-e41c-4786-814d-286dc620d675 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:37.229970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1263-e41c-4786-814d-286dc620d675 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:37.230071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1263-e41c-4786-814d-286dc620d675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:37.248632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c3ee1263-e41c-4786-814d-286dc620d675 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:37.249837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c3ee1263-e41c-4786-814d-286dc620d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:37.279197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:37.321008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 605/1175] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:37.598234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe89f-a996-4efe-95b7-22fb5be82f36 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:37.709962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe89f-a996-4efe-95b7-22fb5be82f36 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:37.744458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4071144-d87e-41f8-bc5f-678e25490915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:37.745090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4071144-d87e-41f8-bc5f-678e25490915 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:37.745378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4071144-d87e-41f8-bc5f-678e25490915 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:37.745659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4071144-d87e-41f8-bc5f-678e25490915 None admin] PATH_INFO: `/v3/domains/3cdfcb0e3f33439c97171908c740a56a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:37.746808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4071144-d87e-41f8-bc5f-678e25490915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3cdfcb0e3f33439c97171908c740a56a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:37.748236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4071144-d87e-41f8-bc5f-678e25490915 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:37.749803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 571/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 17 20:02:37 2022] GET /identity/v3/domains/3cdfcb0e3f33439c97171908c740a56a => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:37.755916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee1263-e41c-4786-814d-286dc620d675 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:37.853649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee1263-e41c-4786-814d-286dc620d675 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:37.887028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de081fe-4f31-45ca-80f7-b28438147297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:37.887636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de081fe-4f31-45ca-80f7-b28438147297 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:37.887921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de081fe-4f31-45ca-80f7-b28438147297 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:37.888201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de081fe-4f31-45ca-80f7-b28438147297 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:37.888858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de081fe-4f31-45ca-80f7-b28438147297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:37.890291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de081fe-4f31-45ca-80f7-b28438147297 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:37.996631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 606/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:02:37 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:39.960908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187a7f-4580-45c8-be67-53e10bbd1af3 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:39.961460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187a7f-4580-45c8-be67-53e10bbd1af3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:39.961460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187a7f-4580-45c8-be67-53e10bbd1af3 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:39.962858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 572/1178] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:39.967983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287e04b-8813-49c7-b6b5-8bd3b7e50e8d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:39.968397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287e04b-8813-49c7-b6b5-8bd3b7e50e8d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:39.968619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287e04b-8813-49c7-b6b5-8bd3b7e50e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:39.987080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5287e04b-8813-49c7-b6b5-8bd3b7e50e8d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:39.988299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5287e04b-8813-49c7-b6b5-8bd3b7e50e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:40.005673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:40.057424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 607/1179] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:40.330272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187a7f-4580-45c8-be67-53e10bbd1af3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:40.341795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:40.435283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187a7f-4580-45c8-be67-53e10bbd1af3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:40.470928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:40.471557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:40.471910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:40.472192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:40.482362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:40.487959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:40.489056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:40.490249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 573/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:40.495313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287e04b-8813-49c7-b6b5-8bd3b7e50e8d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:40.602575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287e04b-8813-49c7-b6b5-8bd3b7e50e8d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:40.638821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:40.639479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:40.639766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:40.640046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:40.641326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:40.641648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:40.643122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:40.652347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 608/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:40.658590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:40.729706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:40.763211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d65c-8569-47d0-8824-de397004cc94 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:40.796582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:40.797847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:40.798128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:40.798401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] PATH_INFO: `/v3/users/80d385dce89c4210a2cad1215941a08a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:40.811368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] RBAC: Authorizing `identity:get_user(user_id=80d385dce89c4210a2cad1215941a08a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:40.813034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:40.815153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 574/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:40 2022] GET /identity/v3/users/80d385dce89c4210a2cad1215941a08a => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:40.821080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:40.837200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:40.921733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4edeb-9f56-4986-947a-50ba5e488cb6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:40.955579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:40.956194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:40.956479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:40.956755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:41.027054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:41.028545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:41.043972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:41.128973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 609/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:41.134945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:41.235513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4737b3-5ce0-4e47-897f-024f9d1821e6 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:41.261726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:41.271228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade2133-068a-4b78-8d3f-772b84d93f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:41.272124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2133-068a-4b78-8d3f-772b84d93f68 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:41.280695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2133-068a-4b78-8d3f-772b84d93f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:41.280695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2133-068a-4b78-8d3f-772b84d93f68 None admin] PATH_INFO: `/v3/projects/82058a3005c249f5b55934c5d4f48a62` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:41.280695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade2133-068a-4b78-8d3f-772b84d93f68 None admin] RBAC: Authorizing `identity:get_project(project_id=82058a3005c249f5b55934c5d4f48a62)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:41.280695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade2133-068a-4b78-8d3f-772b84d93f68 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:41.280695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 575/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:41 2022] GET /identity/v3/projects/82058a3005c249f5b55934c5d4f48a62 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:41.284135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:41.389231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe75dcd-2206-465d-9b2d-339eb95f9335 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:41.404171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:41.425406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08076636-a1e2-4c10-b34e-06b7efbebb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:41.426060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08076636-a1e2-4c10-b34e-06b7efbebb23 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:41.426378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08076636-a1e2-4c10-b34e-06b7efbebb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:41.426735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08076636-a1e2-4c10-b34e-06b7efbebb23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:41.427507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08076636-a1e2-4c10-b34e-06b7efbebb23 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=82058a3005c249f5b55934c5d4f48a62, user.id=80d385dce89c4210a2cad1215941a08a) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:41.427866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08076636-a1e2-4c10-b34e-06b7efbebb23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:41.429421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08076636-a1e2-4c10-b34e-06b7efbebb23 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:41.435728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 610/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:41 2022] GET /identity/v3/role_assignments?user.id=80d385dce89c4210a2cad1215941a08a&scope.project.id=82058a3005c249f5b55934c5d4f48a62&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:43.348137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62071ab-097f-4619-91cf-e9e1a6115ee4 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:43.348671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62071ab-097f-4619-91cf-e9e1a6115ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:43.348671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62071ab-097f-4619-91cf-e9e1a6115ee4 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:43.350047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 576/1186] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:43.355209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af9d0a-a7e1-4bbb-95e5-249c7caa1fb8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:43.355592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af9d0a-a7e1-4bbb-95e5-249c7caa1fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:43.355844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af9d0a-a7e1-4bbb-95e5-249c7caa1fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:43.376004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f9af9d0a-a7e1-4bbb-95e5-249c7caa1fb8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:43.377257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f9af9d0a-a7e1-4bbb-95e5-249c7caa1fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:43.445986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 611/1187] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:43.720418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62071ab-097f-4619-91cf-e9e1a6115ee4 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:43.819545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62071ab-097f-4619-91cf-e9e1a6115ee4 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:43.853322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:43.853955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:43.854241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:43.854520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:43.865138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:43.869834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:43.870967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:02:43.872009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 577/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:43.877437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af9d0a-a7e1-4bbb-95e5-249c7caa1fb8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:43.979464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af9d0a-a7e1-4bbb-95e5-249c7caa1fb8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:43.989105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.014086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:44.014765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:44.015092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:44.015409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:44.016671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:44.017014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:44.018410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:44.026982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 612/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:44.033585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:44.091114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.135357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6483-5ef7-41d1-8d31-79f705032b87 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:44.168907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:44.169525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:44.169804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:44.170076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] PATH_INFO: `/v3/users/80d385dce89c4210a2cad1215941a08a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:44.171196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] RBAC: Authorizing `identity:get_user(user_id=80d385dce89c4210a2cad1215941a08a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:44.173495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:44.175100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 578/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:44 2022] GET /identity/v3/users/80d385dce89c4210a2cad1215941a08a => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:44.181046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:44.285580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a05b21-6891-44d0-ad66-05cd5169212d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:44.319710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3630152-ffc9-4283-9846-2657738737d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:44.320343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3630152-ffc9-4283-9846-2657738737d9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:44.320618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3630152-ffc9-4283-9846-2657738737d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:44.320892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3630152-ffc9-4283-9846-2657738737d9 None admin] PATH_INFO: `/v3/projects/82058a3005c249f5b55934c5d4f48a62` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:44.321995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3630152-ffc9-4283-9846-2657738737d9 None admin] RBAC: Authorizing `identity:get_project(project_id=82058a3005c249f5b55934c5d4f48a62)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:44.323443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3630152-ffc9-4283-9846-2657738737d9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:44.325081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 613/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:44 2022] GET /identity/v3/projects/82058a3005c249f5b55934c5d4f48a62 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:44.332034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:44.431796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cbbe8-f26d-4365-83c5-bf6aa0d54f4e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:44.454815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:44.465840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea8dd-b9b0-4d97-9e99-aa18191bab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:44.466492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea8dd-b9b0-4d97-9e99-aa18191bab8a None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:44.474075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea8dd-b9b0-4d97-9e99-aa18191bab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:44.474075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea8dd-b9b0-4d97-9e99-aa18191bab8a None admin] PATH_INFO: `/v3/projects/82058a3005c249f5b55934c5d4f48a62/users/80d385dce89c4210a2cad1215941a08a/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:44.474075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ea8dd-b9b0-4d97-9e99-aa18191bab8a None admin] RBAC: Authorizing `identity:create_grant(project_id=82058a3005c249f5b55934c5d4f48a62, user_id=80d385dce89c4210a2cad1215941a08a, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:44.474075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ea8dd-b9b0-4d97-9e99-aa18191bab8a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:44.543421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 579/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:44 2022] PUT /identity/v3/projects/82058a3005c249f5b55934c5d4f48a62/users/80d385dce89c4210a2cad1215941a08a/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:02:46.441499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee2b89-56ba-4c83-9d30-7037de1d020d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:46.442056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee2b89-56ba-4c83-9d30-7037de1d020d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:46.442056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee2b89-56ba-4c83-9d30-7037de1d020d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:46.443403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 614/1193] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:46.448501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545131a-49b6-45d1-aae5-3e757ac5392c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:46.448911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545131a-49b6-45d1-aae5-3e757ac5392c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:46.449065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545131a-49b6-45d1-aae5-3e757ac5392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:46.466803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f545131a-49b6-45d1-aae5-3e757ac5392c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:46.467984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f545131a-49b6-45d1-aae5-3e757ac5392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:46.535014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 580/1194] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:46.816713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee2b89-56ba-4c83-9d30-7037de1d020d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:46.857803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:46.918551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee2b89-56ba-4c83-9d30-7037de1d020d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:46.952390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:46.953535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:46.954042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:46.954343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:46.964003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:46.969840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:46.971029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:02:46.972283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 615/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:46.977027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545131a-49b6-45d1-aae5-3e757ac5392c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:47.075037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545131a-49b6-45d1-aae5-3e757ac5392c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:47.088086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:47.108712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:47.109384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:47.109671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:47.109940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:47.110599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:47.110937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:47.112295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:47.120241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 581/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:47.126496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:47.222491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:47.226337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978246cd-b799-4121-828a-f17bae17be1c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:47.260162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:47.260793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:47.261076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:47.261351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] PATH_INFO: `/v3/users/80d385dce89c4210a2cad1215941a08a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:47.262493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] RBAC: Authorizing `identity:get_user(user_id=80d385dce89c4210a2cad1215941a08a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:47.263945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:47.265928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 616/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:47 2022] GET /identity/v3/users/80d385dce89c4210a2cad1215941a08a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:47.271781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:47.373325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702522a-3797-4dff-935f-40c86da6a67e None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:47.405795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:47.407027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:47.407319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:47.407591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:47.448625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:47.473370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:47.474839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:47.572112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 582/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:47.578850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:47.679176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9f49-d961-4708-9ece-490379b0788c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:47.713494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1dde9-193d-4fd0-be6d-3fe6b657a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:47.714117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1dde9-193d-4fd0-be6d-3fe6b657a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:47.714396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1dde9-193d-4fd0-be6d-3fe6b657a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:47.714692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1dde9-193d-4fd0-be6d-3fe6b657a9e2 None admin] PATH_INFO: `/v3/projects/82058a3005c249f5b55934c5d4f48a62` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:47.715784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1dde9-193d-4fd0-be6d-3fe6b657a9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=82058a3005c249f5b55934c5d4f48a62)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:47.717193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1dde9-193d-4fd0-be6d-3fe6b657a9e2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:47.719258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 617/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:47 2022] GET /identity/v3/projects/82058a3005c249f5b55934c5d4f48a62 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:47.725286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:47.802159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:47.828013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445367f1-7913-4151-9c27-30f2fe4c9e67 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:47.862144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3058d5-dc24-4c4f-af2c-f6cea2dea29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:47.862778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3058d5-dc24-4c4f-af2c-f6cea2dea29a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:47.863065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3058d5-dc24-4c4f-af2c-f6cea2dea29a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:47.863340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3058d5-dc24-4c4f-af2c-f6cea2dea29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:47.864059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3058d5-dc24-4c4f-af2c-f6cea2dea29a None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=82058a3005c249f5b55934c5d4f48a62, user.id=80d385dce89c4210a2cad1215941a08a) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:47.864371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3058d5-dc24-4c4f-af2c-f6cea2dea29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:47.865786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3058d5-dc24-4c4f-af2c-f6cea2dea29a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:47.871510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 583/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:47 2022] GET /identity/v3/role_assignments?user.id=80d385dce89c4210a2cad1215941a08a&scope.project.id=82058a3005c249f5b55934c5d4f48a62&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:57.709280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=83 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:57.868890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=31 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:08.704640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce5878-fcab-4215-b095-9072d4744517 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:08.705167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce5878-fcab-4215-b095-9072d4744517 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:08.705267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce5878-fcab-4215-b095-9072d4744517 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:08.706589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 618/1201] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:08.712340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6234-8db3-422d-abfc-6e5303a7e941 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:08.712793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6234-8db3-422d-abfc-6e5303a7e941 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:08.712903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6234-8db3-422d-abfc-6e5303a7e941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:08.730847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-da2e6234-8db3-422d-abfc-6e5303a7e941 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:08.732090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-da2e6234-8db3-422d-abfc-6e5303a7e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:08.800400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 584/1202] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:09.072138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce5878-fcab-4215-b095-9072d4744517 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:09.177755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce5878-fcab-4215-b095-9072d4744517 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:09.211374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:09.211999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:09.212282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:09.212554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:09.223053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:09.224490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:09.239293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:09.241031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:09.242331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:09.242331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:09.242331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:09.242331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 619/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:09.246706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6234-8db3-422d-abfc-6e5303a7e941 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:09.345236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6234-8db3-422d-abfc-6e5303a7e941 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:09.373777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:09.379641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c745b-bc58-44e1-8562-4f42e1a13b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:09.380253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c745b-bc58-44e1-8562-4f42e1a13b31 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:09.380529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c745b-bc58-44e1-8562-4f42e1a13b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:09.380802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c745b-bc58-44e1-8562-4f42e1a13b31 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:09.381436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c745b-bc58-44e1-8562-4f42e1a13b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:09.381741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c745b-bc58-44e1-8562-4f42e1a13b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:09.383127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c745b-bc58-44e1-8562-4f42e1a13b31 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:09.394243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 585/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:09.400453 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:09.454908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:09.502867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5776569-5af3-43ca-95dc-58f215b90954 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:09.536935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12613e4d-f482-48c6-abe3-e8cde33b3524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:09.537543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12613e4d-f482-48c6-abe3-e8cde33b3524 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:09.537822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12613e4d-f482-48c6-abe3-e8cde33b3524 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:09.538097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12613e4d-f482-48c6-abe3-e8cde33b3524 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:09.538765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12613e4d-f482-48c6-abe3-e8cde33b3524 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:09.540225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12613e4d-f482-48c6-abe3-e8cde33b3524 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:09.633632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 620/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 17 20:04:09 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:04:11.582971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5311f-61b0-4cf6-a6bc-ab04e55e9a72 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:11.583520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5311f-61b0-4cf6-a6bc-ab04e55e9a72 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:11.583520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5311f-61b0-4cf6-a6bc-ab04e55e9a72 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:11.584906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 586/1206] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:11.590080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605e29e-5781-438f-b90c-7d4f3339d864 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:11.590497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605e29e-5781-438f-b90c-7d4f3339d864 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:11.590666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605e29e-5781-438f-b90c-7d4f3339d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:11.610352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b605e29e-5781-438f-b90c-7d4f3339d864 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:11.611576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b605e29e-5781-438f-b90c-7d4f3339d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:11.679463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 621/1207] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:11.955235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5311f-61b0-4cf6-a6bc-ab04e55e9a72 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:12.058199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5311f-61b0-4cf6-a6bc-ab04e55e9a72 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:12.093570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:12.094248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:12.094538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:12.094846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:12.105051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:12.109991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:12.113888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:12.114782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 587/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:04:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:12.117519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605e29e-5781-438f-b90c-7d4f3339d864 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:12.158273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:12.217596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605e29e-5781-438f-b90c-7d4f3339d864 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:12.254734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:12.255354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:12.255640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:12.255926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:12.256648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:12.256943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:12.258312 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:12.266968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 622/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:12.273307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:12.327350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:12.378815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95412ec-e135-47f7-84b3-5643006064c5 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:12.411759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:12.412382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:12.412667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:12.412945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:12.424661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:12.429839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:12.440740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:12.442085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:12.443200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:12.443200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:12.443200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:12.443200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 588/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:12.448218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:12.548613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:12.551507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c08f30-7c41-446b-9152-da278e8647b6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:12.585443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:12.586074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:12.586362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:12.586656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:12.587319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:12.587628 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:12.590228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:12.601860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 623/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:12.607676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:12.714340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0f84c-cca2-4f3b-904a-aea6512bba73 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:12.716950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:12.753676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:12.754303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:12.754585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:12.754889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:12.761931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:12.763390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:12.775056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:12.776275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:12.777485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 589/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:12.782814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:12.885252 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cb54-e10a-4b50-8fc5-03004a9cf7b6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:12.921602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:12.923043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:12.923364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:12.923644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:12.924383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:12.924694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:12.926122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:12.944717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 624/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:12.950913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:13.052410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574eae5-9949-4d71-8d22-e027efb94ddd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:13.088298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:13.089211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:13.089211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:13.089477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:13.120684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:13.159964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:13.161369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:13.260856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 590/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:04:13.267060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:13.285936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:13.367728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fece4f-3249-42d4-ab78-d18fedd1704b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:13.402454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:13.403113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:13.403394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:13.403670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:13.420191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:13.420191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:13.431972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:13.433115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:13.434417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:13.434417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:13.434417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:13.434417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 625/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:13.438921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:13.499708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:13.537818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9902a-4e42-4697-867d-b519ebc2c047 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:13.572215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:13.572837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:13.573115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:13.573393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:13.574047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:13.574360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:13.575892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:13.589818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 591/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:13.595683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:13.668458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:13.705355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54b086-ac1f-4257-9ff6-eb033db2b865 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:13.737728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:13.741733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:13.741733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:13.741733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:13.745640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:13.747145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:13.758580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:13.759731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:13.760888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 626/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:04:13.765596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:13.869368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb179634-d959-4aff-a2be-ca68405247df None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:13.892460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:13.903700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72846bb4-ebe9-47cd-8c89-9556efd32d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:13.904301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72846bb4-ebe9-47cd-8c89-9556efd32d3c None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:13.904582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72846bb4-ebe9-47cd-8c89-9556efd32d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:13.904920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72846bb4-ebe9-47cd-8c89-9556efd32d3c None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:13.905599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72846bb4-ebe9-47cd-8c89-9556efd32d3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:13.905933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72846bb4-ebe9-47cd-8c89-9556efd32d3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:13.908392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72846bb4-ebe9-47cd-8c89-9556efd32d3c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:13.919895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 592/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:13.926294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:14.028155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d5c61-9269-4fd3-944f-42bdeb4f78bd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:14.056554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:14.062221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f972f-16a9-4613-9a8d-1fd88ea497f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:14.062849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f972f-16a9-4613-9a8d-1fd88ea497f2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:14.063196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f972f-16a9-4613-9a8d-1fd88ea497f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:14.063699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f972f-16a9-4613-9a8d-1fd88ea497f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:14.064581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f972f-16a9-4613-9a8d-1fd88ea497f2 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=2f3ab28e46424895b2c730edfdcc7cd4) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:14.064888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f972f-16a9-4613-9a8d-1fd88ea497f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:14.066374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f972f-16a9-4613-9a8d-1fd88ea497f2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:14.071678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 627/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:13 2022] GET /identity/v3/role_assignments?user.id=2f3ab28e46424895b2c730edfdcc7cd4&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:15.978746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9894d8b-3201-4828-a9bd-4fea68984149 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:15.979242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9894d8b-3201-4828-a9bd-4fea68984149 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:15.979242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9894d8b-3201-4828-a9bd-4fea68984149 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:15.980700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 593/1220] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:15.986260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc2fb-abf9-4c6c-ae72-f94bb77028b5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:15.988704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc2fb-abf9-4c6c-ae72-f94bb77028b5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:15.988704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc2fb-abf9-4c6c-ae72-f94bb77028b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:16.005646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f76dc2fb-abf9-4c6c-ae72-f94bb77028b5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:16.006912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f76dc2fb-abf9-4c6c-ae72-f94bb77028b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:16.075356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 628/1221] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:16.347375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9894d8b-3201-4828-a9bd-4fea68984149 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:16.454885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9894d8b-3201-4828-a9bd-4fea68984149 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:16.489284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:16.489903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:16.490180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:16.490450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:16.501059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:16.505914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:16.506901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:16.507773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 594/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:04:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:16.513296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dc2fb-abf9-4c6c-ae72-f94bb77028b5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:16.612542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dc2fb-abf9-4c6c-ae72-f94bb77028b5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:16.636793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:16.648196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:16.648808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:16.653452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:16.653452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:16.653452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:16.653452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:16.653452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:16.660127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 629/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:04:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:16.665900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:16.711431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:16.770968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dc29e-3b11-4eae-a316-0ec0d0da7de8 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:16.808601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:16.809231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:16.809517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:16.809797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:16.820394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:16.821839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:16.836220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:16.837327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:16.838203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:16.838203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:16.838203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:16.838203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 595/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:16.843338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:16.945625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc188-cda5-4a45-9e06-8ca138177fb7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:16.979953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:16.980559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:16.980837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:16.981110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:16.981741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:16.982043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:16.983419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:16.996428 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 630/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:17.003122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:17.098339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:17.104938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693590c9-7821-47ae-80a9-fec95b2bb40a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:17.139418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:17.140038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:17.140323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:17.140605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:17.147729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:17.149403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:17.162267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:17.167806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:17.168980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 596/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:17.169567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:17.215469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:17.267251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4a742-5967-424c-ab10-55a5662b8eac None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:17.301029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:17.301639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:17.301922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:17.302199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:17.302965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:17.303272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:17.304693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:17.326852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 631/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:17.333347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:17.435537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80cbbc-7503-4868-adb4-77b78879a68b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:17.469999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:17.470593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:17.470915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:17.471196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:17.481462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:17.482938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:17.497218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:17.499577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:17.501136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:17.501136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:17.501136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:17.501136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 597/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:17.505162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:17.618874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3640b-3f02-4639-985b-5eecefecc9ca None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:17.621449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:17.657611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:17.658296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:17.658679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:17.659035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:17.659722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:17.660031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:17.661419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:17.678682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 632/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:17.680881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:17.691530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:17.785697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e2975-bd29-486a-b2c0-37e2ab6c11ea None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:17.818610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:17.819267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:17.819551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:17.819824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:17.826448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:17.827910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:17.840762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:17.842496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:17.844860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:17.847735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 598/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:17.848774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:17.950070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4685c5f-0f3c-4ccb-8e08-f4e5cd5a1e5c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:17.984336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25099b9f-642c-4883-8944-531ecc02b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:17.984993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099b9f-642c-4883-8944-531ecc02b403 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:17.985276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099b9f-642c-4883-8944-531ecc02b403 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:17.985644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099b9f-642c-4883-8944-531ecc02b403 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:17.986332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25099b9f-642c-4883-8944-531ecc02b403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:17.986667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25099b9f-642c-4883-8944-531ecc02b403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:17.988078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25099b9f-642c-4883-8944-531ecc02b403 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:18.002690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 633/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:18.008948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:18.077420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:18.112912 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81024bd6-3ac2-423c-9512-11f5c2023976 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:18.151538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b107c-cb9f-4a54-93a0-9e62c4448e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:18.152196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b107c-cb9f-4a54-93a0-9e62c4448e7c None admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:18.152482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b107c-cb9f-4a54-93a0-9e62c4448e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:18.152763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b107c-cb9f-4a54-93a0-9e62c4448e7c None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/2f3ab28e46424895b2c730edfdcc7cd4/roles/6666a44189e7493d9de289fe534d6dff` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:18.168027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b107c-cb9f-4a54-93a0-9e62c4448e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=2f3ab28e46424895b2c730edfdcc7cd4, role_id=6666a44189e7493d9de289fe534d6dff)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:18.169536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b107c-cb9f-4a54-93a0-9e62c4448e7c None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:18.313039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 599/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:04:18 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/2f3ab28e46424895b2c730edfdcc7cd4/roles/6666a44189e7493d9de289fe534d6dff => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:04:20.253927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350561a8-3ec9-4f86-a927-d7fb5a8b8398 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:20.254481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350561a8-3ec9-4f86-a927-d7fb5a8b8398 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:20.254481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350561a8-3ec9-4f86-a927-d7fb5a8b8398 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:20.255879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 634/1233] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:20.261415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc7c7-e3cd-4c4f-aa26-7b1bd1a8e2d3 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:20.262190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc7c7-e3cd-4c4f-aa26-7b1bd1a8e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:20.262190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc7c7-e3cd-4c4f-aa26-7b1bd1a8e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:20.280443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d6edc7c7-e3cd-4c4f-aa26-7b1bd1a8e2d3 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:20.282196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d6edc7c7-e3cd-4c4f-aa26-7b1bd1a8e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:20.354189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 600/1234] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:20.638504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350561a8-3ec9-4f86-a927-d7fb5a8b8398 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:20.672703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:20.755298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350561a8-3ec9-4f86-a927-d7fb5a8b8398 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:20.790415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:20.791094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:20.791804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:20.791804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:20.803053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:20.807993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:20.809072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:20.810267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 635/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 17 20:04:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:20.816275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edc7c7-e3cd-4c4f-aa26-7b1bd1a8e2d3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:20.864765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:20.920389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edc7c7-e3cd-4c4f-aa26-7b1bd1a8e2d3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:20.959551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:20.960169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:20.960454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:20.960735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:20.961496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] RBAC: Adding query filter params (name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:20.965320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:20.965320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:20.974533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 601/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 17 20:04:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:20.980547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:21.066959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:21.082463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b453987-e757-4cfb-85fb-b83c40554faa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:21.118712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:21.119348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:21.121760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:21.121760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:21.130403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:21.131883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:21.147683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:21.154379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:21.155367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:21.155367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:21.155367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:21.155367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 636/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:21.155656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:21.257748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e66ee-4357-4cad-a684-2d63d19a563f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:21.267363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:21.292633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:21.293281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:21.293568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:21.293846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:21.294524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:21.294858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:21.296235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:21.308561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 602/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:21.314617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:21.415745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e1eae-5edf-42c8-af0e-7f9c210a4d15 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:21.453044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:21.454207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:21.454492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:21.454800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:21.457656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:21.462765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:21.464207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:21.476032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:21.481638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:21.487235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 637/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:21.487823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:21.588855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d519c87-408f-4f92-86d5-4447b0eab26a None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:21.624490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:21.625084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:21.626335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:21.626617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:21.627393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:21.627700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:21.629123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:21.647427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 603/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:21.653945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:21.753348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ae278-b656-45e7-b426-2dc80df984a0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:21.787237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:21.787847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:21.788127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:21.788402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:21.849799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:21.856125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:21.857556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:21.967270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 638/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:04:21.973627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:22.002659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:22.078693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e4e8-1316-4970-b310-f3366090e0ea None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:22.113578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:22.114103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.114390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.114691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.128498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:22.130007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:22.145196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:22.146146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:22.147105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:22.147105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:22.147105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:22.147105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 604/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:22.152572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:22.246436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:22.254956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29436c6a-0843-4bb6-ba74-a46adc3bed28 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:22.291800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:22.292406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.292682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.292952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.293594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:22.293897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:22.295292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:22.306833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 639/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:22.312734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:22.396065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:22.418041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aab1f0-e288-4e30-9745-269e46216477 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:22.452843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:22.454170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.454460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.454763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.461665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:22.463161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:22.474860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:22.475941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:22.476856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 605/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:22.483043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:22.587342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1cce-057f-490f-aea2-2404b56569fa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:22.621067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24fae-5d69-46b7-b2f4-12a7ee48e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:22.621667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24fae-5d69-46b7-b2f4-12a7ee48e337 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.621949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24fae-5d69-46b7-b2f4-12a7ee48e337 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.622223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24fae-5d69-46b7-b2f4-12a7ee48e337 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.622938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24fae-5d69-46b7-b2f4-12a7ee48e337 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:22.623245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24fae-5d69-46b7-b2f4-12a7ee48e337 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:22.624710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24fae-5d69-46b7-b2f4-12a7ee48e337 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:22.637035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 640/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:22.644448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:22.746171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008fdf-7c53-4a81-88ba-a55eb644bec3 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:22.780538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5da6e-b494-4e87-8ac7-08daaf13c263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:22.781145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5da6e-b494-4e87-8ac7-08daaf13c263 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.781517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5da6e-b494-4e87-8ac7-08daaf13c263 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.781885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5da6e-b494-4e87-8ac7-08daaf13c263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.782829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5da6e-b494-4e87-8ac7-08daaf13c263 None admin] RBAC: Adding query filter params (role.id=6666a44189e7493d9de289fe534d6dff, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=2f3ab28e46424895b2c730edfdcc7cd4) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:22.783146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5da6e-b494-4e87-8ac7-08daaf13c263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:22.784566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5da6e-b494-4e87-8ac7-08daaf13c263 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:22.790341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 606/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:22 2022] GET /identity/v3/role_assignments?user.id=2f3ab28e46424895b2c730edfdcc7cd4&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=6666a44189e7493d9de289fe534d6dff => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:24.806865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642b92e-0dba-4cbc-8e40-22e87d9b96d4 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:24.807452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642b92e-0dba-4cbc-8e40-22e87d9b96d4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:24.807601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642b92e-0dba-4cbc-8e40-22e87d9b96d4 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:24.809113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 641/1247] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:24.815433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8722-8bee-431d-b0f6-cb0992ee2d1a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:24.815877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8722-8bee-431d-b0f6-cb0992ee2d1a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:24.815973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8722-8bee-431d-b0f6-cb0992ee2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:24.822191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:24.835697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-722f8722-8bee-431d-b0f6-cb0992ee2d1a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:24.836889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-722f8722-8bee-431d-b0f6-cb0992ee2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:24.905506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 607/1248] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:25.182780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642b92e-0dba-4cbc-8e40-22e87d9b96d4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:25.201164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:25.285846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642b92e-0dba-4cbc-8e40-22e87d9b96d4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:25.321339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:25.321974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:25.322285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:25.322791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:25.334863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:25.339755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:25.340897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:25.342028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 642/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:25.347968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f8722-8bee-431d-b0f6-cb0992ee2d1a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:25.458707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f8722-8bee-431d-b0f6-cb0992ee2d1a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:25.486975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:25.491783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:25.492393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:25.492708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:25.492990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:25.493666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:25.493971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:25.495362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:25.504738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 608/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:25.510746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:25.588765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:25.610682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66818ca-1f71-4e3b-8d4c-136f1cd2b741 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:25.644797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:25.645422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:25.645702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:25.645975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:25.656915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:25.658345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:25.672318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:25.673304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:25.675391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:25.675391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:25.675391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:25.675391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 643/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:25.679608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:25.783223 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f24b7b-0e02-432c-8975-02f9793053f4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:25.817512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:25.818347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:25.818453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:25.818664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:25.819306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:25.819605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:25.820952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:25.833158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 609/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:25.839017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:25.941940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41bdd-2d4c-486e-baba-ea49712fafc7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:25.967730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:25.976626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:25.977278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:25.977566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:25.977848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:25.987427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:25.988902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:26.001874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:26.003164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:26.004112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 644/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:26.009524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:26.067329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:26.110606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126d948-5938-4e76-a6b8-9c4c25b5551f None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:26.143809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:26.144402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:26.144680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:26.144951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:26.145732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:26.146010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:26.147455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:26.165731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 610/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:26.171681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:26.275651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6395b2-134b-417c-80bc-a133c00a87c8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:26.314784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:26.315395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:26.315680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:26.315953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:26.372415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:26.384476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:26.385959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:26.485469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 645/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:04:26.491545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:26.595305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba85720-4244-456e-a8e0-bd7bf9d93790 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:26.609493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:26.631001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:26.631601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:26.631884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:26.632162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:26.642866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:26.644320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:26.659640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:26.660761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:26.661845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:26.661845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:26.661845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:26.661845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 611/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:26.666442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:26.757103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:26.770098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9437-4cb5-4ae0-8812-b464e8eb61aa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:26.804956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:26.805599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:26.805880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:26.806152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:26.806864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:26.807171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:26.808606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:26.820487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 646/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:26.826208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:26.931221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cae43-e076-4ed3-9ea2-b5413553a305 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:26.966940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:26.967594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:26.967881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:26.968189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:26.976025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:26.978720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:26.989335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:26.990495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:26.991501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 612/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:26.996582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:27.103533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3147d0a-2be2-4d13-86c6-d6ba34a6246c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:27.138446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26672663-6ea3-402a-bdae-d17eef5d9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:27.139084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672663-6ea3-402a-bdae-d17eef5d9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:27.139401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672663-6ea3-402a-bdae-d17eef5d9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:27.139713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672663-6ea3-402a-bdae-d17eef5d9fc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:27.140433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26672663-6ea3-402a-bdae-d17eef5d9fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:27.141370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26672663-6ea3-402a-bdae-d17eef5d9fc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:27.142890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26672663-6ea3-402a-bdae-d17eef5d9fc9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:27.155161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 647/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:27.161947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:27.190310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:27.267396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc56de-7b5e-466f-a497-186d3e7ae7dd None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:27.307185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2e0f4-e587-4c35-9dd7-e62b3e9f0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:27.307802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2e0f4-e587-4c35-9dd7-e62b3e9f0503 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:27.308090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2e0f4-e587-4c35-9dd7-e62b3e9f0503 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:27.308571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2e0f4-e587-4c35-9dd7-e62b3e9f0503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:27.309311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2e0f4-e587-4c35-9dd7-e62b3e9f0503 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=2f3ab28e46424895b2c730edfdcc7cd4) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:27.309626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2e0f4-e587-4c35-9dd7-e62b3e9f0503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:27.311131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2e0f4-e587-4c35-9dd7-e62b3e9f0503 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:27.317750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 613/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:27 2022] GET /identity/v3/role_assignments?user.id=2f3ab28e46424895b2c730edfdcc7cd4&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:29.256438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd3b1b-e5d6-495e-bbee-605cfa1ab62c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:29.257010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd3b1b-e5d6-495e-bbee-605cfa1ab62c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:29.257010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd3b1b-e5d6-495e-bbee-605cfa1ab62c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:29.258405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 648/1261] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:29.264278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacea23-b94c-4b18-980e-69725490a354 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:29.264838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacea23-b94c-4b18-980e-69725490a354 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:29.264838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacea23-b94c-4b18-980e-69725490a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:29.286225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bbacea23-b94c-4b18-980e-69725490a354 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:29.287479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bbacea23-b94c-4b18-980e-69725490a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:29.361122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 614/1262] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:29.632427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd3b1b-e5d6-495e-bbee-605cfa1ab62c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:29.644200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:29.736148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd3b1b-e5d6-495e-bbee-605cfa1ab62c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:29.770602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:29.771259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:29.771544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:29.771821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:29.782505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:29.787226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:29.788329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:29.789621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 649/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:29.794418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacea23-b94c-4b18-980e-69725490a354 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:29.813118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:29.895092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacea23-b94c-4b18-980e-69725490a354 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:29.929878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:29.930489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:29.930805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:29.931087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:29.931748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:29.932055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:29.933465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:29.942224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 615/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:29.948145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:30.017715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:30.051228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0bc0b-62e4-414b-bb3c-59a8fe736124 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:30.084959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:30.085583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:30.085861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:30.086133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:30.096799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:30.098239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:30.113120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:30.114336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:30.115417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:30.115417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:30.115417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:30.115417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 650/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:30.120052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:30.204178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:30.223144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b60a-426f-4ecf-b5d3-3e07be5f20f2 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:30.259707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:30.261589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:30.261589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:30.261589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:30.261589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:30.261985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:30.263216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:30.275011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 616/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:30.280934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:30.381788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3b9e7-daf8-4456-9f71-02da81d78877 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:30.404194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:30.419035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:30.419675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:30.419959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:30.420236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:30.428405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:30.429829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:30.441343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:30.442743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:30.451769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 651/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:30.452498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:30.550388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6b15-421b-430d-8251-05cabe5b23c0 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:30.584593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:30.585197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:30.585482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:30.585800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:30.586527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:30.586869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:30.588292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:30.597930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:30.605883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 617/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:30.611847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:30.715122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5481f-cfdf-4986-882e-b125b29d983c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:30.749074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:30.749696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:30.750720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:30.751080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:30.761778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:30.763284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:30.777720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:30.778857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:30.779800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:30.779800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:30.779800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:30.779800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 652/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:30.784810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:30.892677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c74172-0889-45c1-be56-2d71fb57fb0b None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:30.929421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:30.930029 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:30.930311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:30.930586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:30.931273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:30.931580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:30.932936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:30.948080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 618/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:30.954026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:30.987281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:31.066690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e9035-4277-4f23-8bba-b1c2d8eb51a9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:31.110362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:31.114807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.114807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.114807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.118864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:31.120314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:31.133360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:31.134595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:31.135840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 653/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:31.140984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:31.216539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:31.264757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874ee0-a2e7-471e-87ab-fdae571bc2fe None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:31.304826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd3242-207c-49fc-83ff-710ced8363ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:31.305852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd3242-207c-49fc-83ff-710ced8363ea None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.306093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd3242-207c-49fc-83ff-710ced8363ea None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.306368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd3242-207c-49fc-83ff-710ced8363ea None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.307089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd3242-207c-49fc-83ff-710ced8363ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:31.307396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd3242-207c-49fc-83ff-710ced8363ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:31.308848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd3242-207c-49fc-83ff-710ced8363ea None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:31.325426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 619/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:31.333366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:31.433813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:31.442857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5685-a419-4640-a087-5f39ac90c160 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:31.478544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34986c-e839-4722-ae20-0dbb66d42fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:31.479151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34986c-e839-4722-ae20-0dbb66d42fd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.479436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34986c-e839-4722-ae20-0dbb66d42fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.479716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34986c-e839-4722-ae20-0dbb66d42fd5 None admin] PATH_INFO: `/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/2f3ab28e46424895b2c730edfdcc7cd4/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.481712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34986c-e839-4722-ae20-0dbb66d42fd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c3c3e62ee0461c9fdcb6491c8178c3, user_id=2f3ab28e46424895b2c730edfdcc7cd4, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:31.483269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34986c-e839-4722-ae20-0dbb66d42fd5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:31.659451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 654/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 17 20:04:31 2022] PUT /identity/v3/projects/96c3c3e62ee0461c9fdcb6491c8178c3/users/2f3ab28e46424895b2c730edfdcc7cd4/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:04:33.598220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123193b-b1b2-4215-b36b-05add776ef17 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:33.598811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123193b-b1b2-4215-b36b-05add776ef17 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:33.598811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123193b-b1b2-4215-b36b-05add776ef17 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:33.600202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 620/1274] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:33.605971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae6d00-4732-4f26-82dd-2aaf64747575 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:33.606398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae6d00-4732-4f26-82dd-2aaf64747575 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:33.606528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae6d00-4732-4f26-82dd-2aaf64747575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:33.626019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dcae6d00-4732-4f26-82dd-2aaf64747575 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:33.627237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dcae6d00-4732-4f26-82dd-2aaf64747575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:33.704155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 655/1275] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:33.988675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123193b-b1b2-4215-b36b-05add776ef17 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:34.097887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123193b-b1b2-4215-b36b-05add776ef17 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:34.116758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:34.134484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:34.135156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:34.135433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:34.135708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:34.146903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:34.152047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:34.153138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:34.154340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 621/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 17 20:04:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:34.159922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae6d00-4732-4f26-82dd-2aaf64747575 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:34.243467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:34.261830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae6d00-4732-4f26-82dd-2aaf64747575 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:34.297995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:34.298719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:34.299003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:34.299279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:34.299949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:34.300287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:34.301645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:34.310176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 656/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 17 20:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:34.316918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:34.419359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5d125-cf83-488c-9529-75be62bd8bb8 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:34.454613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:34.455538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:34.455814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:34.456085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:34.465829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:34.467298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:34.481900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:34.483134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:34.485123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:34.485123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:34.485123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:34.485123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 622/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:34.489603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:34.590809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d818c7-49fa-4e55-88ef-b6d6881fa75c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:34.625600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:34.626386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:34.626705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:34.626991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:34.627637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:34.627947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:34.629315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:34.641906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 657/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:34.647861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:34.681470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:34.752351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9364150-9f86-4265-8239-2d318f45d68d None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:34.788792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:34.806337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:34.806337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:34.806337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:34.806337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:34.806337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:34.810571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:34.811782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:34.813528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 623/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:34.818880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:34.822949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:34.919196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aa65b-6223-4ab5-9d3b-76dd9ce63b6f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:34.955706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:34.956305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:34.956580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:34.956880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:34.957682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:34.957972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:34.959439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:34.976666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 658/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:34.982729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:35.072912 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:35.084015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb7c18-d577-4b24-8b14-aad872125045 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:35.117294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:35.117537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:35.117782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:35.118058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:35.188425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:35.189783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:35.281176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:35.291357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 624/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:04:35.297969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:35.362644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:35.401098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97531f-36c0-4272-916e-9b5689982270 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:35.434867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:35.435496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:35.435785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:35.436061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:35.450703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:35.450703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:35.463202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:35.464427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:35.465517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:35.465517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:35.465517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:35.465517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 659/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:35.470297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:35.573424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97881317-e91c-4f98-9183-8c354799efa9 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:35.608376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:35.608993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:35.609341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:35.609613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:35.610297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:35.610608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:35.611999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:35.623679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 625/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:35.630374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:35.744128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e3ba-43f9-416e-a2c4-805517a5035c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:35.758756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:35.780206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:35.780839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:35.781275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:35.781568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:35.788268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:35.789703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:35.800765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:35.801797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 20:04:35.803193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 660/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:35.807852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:35.860392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:35.911081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d40dee-c7b1-4060-9cee-20a10a36a6f4 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:35.946654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57f066-731c-46e3-8aaf-3d59081c6cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:35.947302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57f066-731c-46e3-8aaf-3d59081c6cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:35.947587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57f066-731c-46e3-8aaf-3d59081c6cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:35.947881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57f066-731c-46e3-8aaf-3d59081c6cb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:35.949174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57f066-731c-46e3-8aaf-3d59081c6cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:35.949174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57f066-731c-46e3-8aaf-3d59081c6cb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:35.950352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57f066-731c-46e3-8aaf-3d59081c6cb9 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:35.963384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 626/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:35.969892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:36.074499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa324-36cf-4482-b0ac-5386d56ed2ec None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:36.110537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dede7-4fcb-4241-9543-3d9d085fd803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:36.111220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dede7-4fcb-4241-9543-3d9d085fd803 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:36.111505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dede7-4fcb-4241-9543-3d9d085fd803 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:36.111781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dede7-4fcb-4241-9543-3d9d085fd803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:36.112508 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dede7-4fcb-4241-9543-3d9d085fd803 None admin] RBAC: Adding query filter params (role.id=0dae4c7453cb4002973f39bc52b35d8e, scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3, user.id=2f3ab28e46424895b2c730edfdcc7cd4) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:36.112817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dede7-4fcb-4241-9543-3d9d085fd803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:36.114246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dede7-4fcb-4241-9543-3d9d085fd803 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:36.120952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 661/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:35 2022] GET /identity/v3/role_assignments?user.id=2f3ab28e46424895b2c730edfdcc7cd4&scope.project.id=96c3c3e62ee0461c9fdcb6491c8178c3&role.id=0dae4c7453cb4002973f39bc52b35d8e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:38.085024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158873-7c05-40a3-985a-a0a1894e0335 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:38.085860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158873-7c05-40a3-985a-a0a1894e0335 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:38.086027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158873-7c05-40a3-985a-a0a1894e0335 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:38.087532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 627/1288] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:38.092775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3fa81-69f3-494b-ad4d-96cc3a25af3c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:38.093217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3fa81-69f3-494b-ad4d-96cc3a25af3c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:38.093324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3fa81-69f3-494b-ad4d-96cc3a25af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:38.112584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-16c3fa81-69f3-494b-ad4d-96cc3a25af3c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:38.113787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16c3fa81-69f3-494b-ad4d-96cc3a25af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:38.144531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:38.183393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 662/1289] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:38.449942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158873-7c05-40a3-985a-a0a1894e0335 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:38.553666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158873-7c05-40a3-985a-a0a1894e0335 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:38.565307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:38.589685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:38.591969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:38.591969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:38.591969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:38.591969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:38.592896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:38.601517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:38.602598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:38.603661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 628/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:04:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:38.608723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3fa81-69f3-494b-ad4d-96cc3a25af3c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:38.716272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3fa81-69f3-494b-ad4d-96cc3a25af3c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:38.751202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd2d75-f812-4117-bddc-80cf34372e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:38.751801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2d75-f812-4117-bddc-80cf34372e1f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:38.752082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2d75-f812-4117-bddc-80cf34372e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:38.752357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2d75-f812-4117-bddc-80cf34372e1f None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:38.752980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2d75-f812-4117-bddc-80cf34372e1f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:38.753282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2d75-f812-4117-bddc-80cf34372e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:38.754662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2d75-f812-4117-bddc-80cf34372e1f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:38.759512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 663/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:38.766035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:38.865961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c999-8318-4fa2-800a-da36da91f238 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:38.900568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8aba1-9bb3-4236-b75e-8e8d84de6c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:38.901165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8aba1-9bb3-4236-b75e-8e8d84de6c55 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:38.901441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8aba1-9bb3-4236-b75e-8e8d84de6c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:38.901714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8aba1-9bb3-4236-b75e-8e8d84de6c55 None admin] PATH_INFO: `/v3/services` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:38.902392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8aba1-9bb3-4236-b75e-8e8d84de6c55 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:38.902731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8aba1-9bb3-4236-b75e-8e8d84de6c55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:38.904084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8aba1-9bb3-4236-b75e-8e8d84de6c55 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:38.908767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 629/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:40.829672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efa05d-61f4-4ab7-a233-a650d70fe4f7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:40.830430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efa05d-61f4-4ab7-a233-a650d70fe4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:40.830430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efa05d-61f4-4ab7-a233-a650d70fe4f7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:40.831760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 664/1293] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:40.838833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad52318-c1f7-48ba-b914-369f4c914223 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:40.838833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad52318-c1f7-48ba-b914-369f4c914223 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:40.838833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad52318-c1f7-48ba-b914-369f4c914223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:40.856908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5ad52318-c1f7-48ba-b914-369f4c914223 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:40.858111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5ad52318-c1f7-48ba-b914-369f4c914223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:40.889866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:40.931351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 630/1294] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:41.204889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efa05d-61f4-4ab7-a233-a650d70fe4f7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:41.236836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:41.311102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efa05d-61f4-4ab7-a233-a650d70fe4f7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:41.346550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1f132-9f9e-4894-a915-24a885aa9b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:41.347193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f132-9f9e-4894-a915-24a885aa9b99 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:41.347479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f132-9f9e-4894-a915-24a885aa9b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:41.347754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f132-9f9e-4894-a915-24a885aa9b99 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:41.348399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1f132-9f9e-4894-a915-24a885aa9b99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:41.349761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1f132-9f9e-4894-a915-24a885aa9b99 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:41.491132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 665/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 17 20:04:41 2022] POST /identity/v3/services => generated 246 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:04:43.474894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112824-ed85-4bb1-880e-5c599b55f059 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:43.475464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112824-ed85-4bb1-880e-5c599b55f059 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:43.475464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112824-ed85-4bb1-880e-5c599b55f059 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:43.476854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 631/1296] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:43.482201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f96caf-4928-4ce0-8738-dbd8af3df6bf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:43.482649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f96caf-4928-4ce0-8738-dbd8af3df6bf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:43.482915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f96caf-4928-4ce0-8738-dbd8af3df6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:43.502161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-98f96caf-4928-4ce0-8738-dbd8af3df6bf None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:43.503392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-98f96caf-4928-4ce0-8738-dbd8af3df6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:43.581481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 666/1297] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:43.853285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112824-ed85-4bb1-880e-5c599b55f059 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:43.959413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112824-ed85-4bb1-880e-5c599b55f059 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:43.994798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:43.995427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:43.995711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:43.995988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:43.996569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:43.997936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:44.007230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:44.008495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:44.009359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 632/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:04:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:44.014557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f96caf-4928-4ce0-8738-dbd8af3df6bf None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:44.033626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:44.114250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f96caf-4928-4ce0-8738-dbd8af3df6bf None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:44.148477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:44.149353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:44.149640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:44.149923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:44.150559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:44.150951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:44.152323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:44.158231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 667/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:44.164439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:44.196019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:44.268627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865601-84fb-4e3c-84df-b0bf00ff8699 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:44.304271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801e3db-9419-44d1-84d7-956dc667e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:44.304883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801e3db-9419-44d1-84d7-956dc667e435 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:44.305163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801e3db-9419-44d1-84d7-956dc667e435 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:44.305472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801e3db-9419-44d1-84d7-956dc667e435 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:44.306152 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801e3db-9419-44d1-84d7-956dc667e435 None admin] RBAC: Adding query filter params (interface=public, service_id=e3e06a6ba02a430db5ca47778e112c49, region_id=RegionOne) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:44.306462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801e3db-9419-44d1-84d7-956dc667e435 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:44.307852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801e3db-9419-44d1-84d7-956dc667e435 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:44.313520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 633/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 17 20:04:44 2022] GET /identity/v3/endpoints?service_id=e3e06a6ba02a430db5ca47778e112c49&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:44.319453 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:44.422841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79677136-5b4f-4ecb-8041-753858a3df14 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:44.436967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:44.461473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18e904-376e-4e43-b8f3-0984dffca422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:44.462214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e904-376e-4e43-b8f3-0984dffca422 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:44.462497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e904-376e-4e43-b8f3-0984dffca422 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:44.462805 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e904-376e-4e43-b8f3-0984dffca422 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:44.463409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18e904-376e-4e43-b8f3-0984dffca422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:44.464765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18e904-376e-4e43-b8f3-0984dffca422 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:44.472243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 668/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 17 20:04:44 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:04:46.434109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0492-41f3-44b2-a70c-5eda952169fc None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.434709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0492-41f3-44b2-a70c-5eda952169fc None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.434709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0492-41f3-44b2-a70c-5eda952169fc None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.436063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 634/1302] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:46.442105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0e07-c832-42cc-9910-078ad784508e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.442577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0e07-c832-42cc-9910-078ad784508e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.442700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0e07-c832-42cc-9910-078ad784508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.461533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-95dd0e07-c832-42cc-9910-078ad784508e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:46.462774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-95dd0e07-c832-42cc-9910-078ad784508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:46.533240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 669/1303] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:46.813616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0492-41f3-44b2-a70c-5eda952169fc None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:46.920723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:46.929214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0492-41f3-44b2-a70c-5eda952169fc None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:46.968124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:46.969327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.969611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.969991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.970585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:46.971990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:46.981479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:46.982762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: ERROR keystone.server.flask.application Aug 17 20:04:46.984537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 635/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 17 20:04:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:46.989510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0e07-c832-42cc-9910-078ad784508e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:47.072582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:47.096829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0e07-c832-42cc-9910-078ad784508e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:47.131563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdacb4e-a91c-4db0-a549-fe3408ed5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:47.132172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdacb4e-a91c-4db0-a549-fe3408ed5105 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:47.132458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdacb4e-a91c-4db0-a549-fe3408ed5105 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:47.132736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdacb4e-a91c-4db0-a549-fe3408ed5105 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:47.133372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdacb4e-a91c-4db0-a549-fe3408ed5105 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:47.133679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdacb4e-a91c-4db0-a549-fe3408ed5105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:47.135103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdacb4e-a91c-4db0-a549-fe3408ed5105 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:47.140753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 670/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:47.147110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:47.252017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac9c8-33e2-46b8-87db-bc572c4fe036 None admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:47.286287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d1c5-d2e9-4fa6-91e5-153a4035e53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:47.286932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d1c5-d2e9-4fa6-91e5-153a4035e53b None admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:47.287218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d1c5-d2e9-4fa6-91e5-153a4035e53b None admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:47.287491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d1c5-d2e9-4fa6-91e5-153a4035e53b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:47.288174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9d1c5-d2e9-4fa6-91e5-153a4035e53b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:47.289560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9d1c5-d2e9-4fa6-91e5-153a4035e53b None admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:47.479718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 636/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:04:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:04:57.152489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=30 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:57.474774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:33.298476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5b89-8632-4d34-9d3f-9695d85cee06 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:33.300716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5b89-8632-4d34-9d3f-9695d85cee06 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:33.301803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5b89-8632-4d34-9d3f-9695d85cee06 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:33.312444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53615-282d-438e-91e9-8bef2cac3724 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:33.312892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53615-282d-438e-91e9-8bef2cac3724 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:33.312998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53615-282d-438e-91e9-8bef2cac3724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:33.318601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 671/1307] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:33 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:33.419774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0ef53615-282d-438e-91e9-8bef2cac3724 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:33.421013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0ef53615-282d-438e-91e9-8bef2cac3724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:33.578652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 637/1308] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:33.894797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02d9ff-9969-4591-9ee7-84c1e0855f91 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:33.895269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02d9ff-9969-4591-9ee7-84c1e0855f91 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:33.895768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02d9ff-9969-4591-9ee7-84c1e0855f91 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:33.898267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 672/1309] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 17 20:12:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:12:33.908931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aaa2f-e0b1-4665-9d1f-231ab2f3d555 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:33.909345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aaa2f-e0b1-4665-9d1f-231ab2f3d555 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:33.909709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aaa2f-e0b1-4665-9d1f-231ab2f3d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:34.019775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e32aaa2f-e0b1-4665-9d1f-231ab2f3d555 None None] MFA Rules not processed for user `765ee8241c4e448eb999016b17132e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:34.021022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e32aaa2f-e0b1-4665-9d1f-231ab2f3d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:34.044861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:34.112837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 638/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 17 20:12:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:34.122233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02d9ff-9969-4591-9ee7-84c1e0855f91 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:34.124040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9e02d9ff-9969-4591-9ee7-84c1e0855f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:34.248501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02d9ff-9969-4591-9ee7-84c1e0855f91 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:34.332130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b24d9e-d8f6-44d6-a940-a9085ede5c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:34.332877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24d9e-d8f6-44d6-a940-a9085ede5c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:34.332974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24d9e-d8f6-44d6-a940-a9085ede5c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:34.333202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24d9e-d8f6-44d6-a940-a9085ede5c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:34.334962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d0b24d9e-d8f6-44d6-a940-a9085ede5c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:34.397640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:34.455285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b24d9e-d8f6-44d6-a940-a9085ede5c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:34.456733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b24d9e-d8f6-44d6-a940-a9085ede5c4d service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:34.476868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 673/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:36.761615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12055f0-7018-4554-8003-c1b334492af2 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:36.762242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12055f0-7018-4554-8003-c1b334492af2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:36.762242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12055f0-7018-4554-8003-c1b334492af2 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:36.763836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 639/1312] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:36.770171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcc6e-1bc6-4d4b-801a-5194e9a05aa2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:36.771173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcc6e-1bc6-4d4b-801a-5194e9a05aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:36.772097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcc6e-1bc6-4d4b-801a-5194e9a05aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:36.877246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e70bcc6e-1bc6-4d4b-801a-5194e9a05aa2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:36.878490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e70bcc6e-1bc6-4d4b-801a-5194e9a05aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:37.009942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 674/1313] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:37.299067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12055f0-7018-4554-8003-c1b334492af2 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:37.301142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a12055f0-7018-4554-8003-c1b334492af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:37.426582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12055f0-7018-4554-8003-c1b334492af2 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:37.508314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:37.512283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e3175-11bd-4e55-a5fc-4a11372eef02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:37.512905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3175-11bd-4e55-a5fc-4a11372eef02 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:37.513577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3175-11bd-4e55-a5fc-4a11372eef02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:37.513577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3175-11bd-4e55-a5fc-4a11372eef02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:37.515214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b89e3175-11bd-4e55-a5fc-4a11372eef02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:37.638602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e3175-11bd-4e55-a5fc-4a11372eef02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:37.640086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e3175-11bd-4e55-a5fc-4a11372eef02 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:37.659612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 640/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:40.214983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf580b1-4208-492c-bde2-3623841f22de None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:40.215562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf580b1-4208-492c-bde2-3623841f22de None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:40.215562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf580b1-4208-492c-bde2-3623841f22de None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:40.217099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 675/1315] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:40.222805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb25c-22c1-4ec9-b429-c53e73de00c7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:40.223352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb25c-22c1-4ec9-b429-c53e73de00c7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:40.223610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb25c-22c1-4ec9-b429-c53e73de00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:40.305242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-339bb25c-22c1-4ec9-b429-c53e73de00c7 None None] MFA Rules not processed for user `37aa59325ec5426a8f56e75d1c2bbad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:40.307315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-339bb25c-22c1-4ec9-b429-c53e73de00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:40.366569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:40.417670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 641/1316] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:40.707444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf580b1-4208-492c-bde2-3623841f22de None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:40.709030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bcf580b1-4208-492c-bde2-3623841f22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:40.720061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:40.820619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf580b1-4208-492c-bde2-3623841f22de None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:40.896939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b2f68-da6e-4470-b9d1-986cae1329ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:40.897545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2f68-da6e-4470-b9d1-986cae1329ed service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:40.897823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2f68-da6e-4470-b9d1-986cae1329ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:40.898091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2f68-da6e-4470-b9d1-986cae1329ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:40.899742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bd9b2f68-da6e-4470-b9d1-986cae1329ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:40.965423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:41.018752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b2f68-da6e-4470-b9d1-986cae1329ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:41.020431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b2f68-da6e-4470-b9d1-986cae1329ed service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:41.053782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 676/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:44.127205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272fe4d-6b2c-48b4-b3d0-1253754e81ff None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:44.128023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272fe4d-6b2c-48b4-b3d0-1253754e81ff None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:44.128023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272fe4d-6b2c-48b4-b3d0-1253754e81ff None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:44.129383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 642/1318] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:12:44.135399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd9ca-c898-4ea7-a567-3166a3792411 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:44.136164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd9ca-c898-4ea7-a567-3166a3792411 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:44.136164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd9ca-c898-4ea7-a567-3166a3792411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:44.207884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7a6fd9ca-c898-4ea7-a567-3166a3792411 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:44.209103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7a6fd9ca-c898-4ea7-a567-3166a3792411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:44.310230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 677/1319] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:12:44.600717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272fe4d-6b2c-48b4-b3d0-1253754e81ff None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:44.602248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6272fe4d-6b2c-48b4-b3d0-1253754e81ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:44.709763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272fe4d-6b2c-48b4-b3d0-1253754e81ff None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:44.786281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a0974-1f19-4516-8a47-1572d80dfeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:44.786924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0974-1f19-4516-8a47-1572d80dfeff service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:44.787206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0974-1f19-4516-8a47-1572d80dfeff service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:44.787479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0974-1f19-4516-8a47-1572d80dfeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:44.789097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d98a0974-1f19-4516-8a47-1572d80dfeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:44.797302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:44.903703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a0974-1f19-4516-8a47-1572d80dfeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:44.905174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a0974-1f19-4516-8a47-1572d80dfeff service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:44.926265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 643/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:48.931447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236fe53-6623-4ffe-a976-69e16d1b6c20 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:48.932524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236fe53-6623-4ffe-a976-69e16d1b6c20 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:48.932524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236fe53-6623-4ffe-a976-69e16d1b6c20 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:48.934138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 678/1321] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:48.940514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4aecf-0b82-4bfa-9ec7-808a7c9753b2 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:48.941130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4aecf-0b82-4bfa-9ec7-808a7c9753b2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:48.941398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4aecf-0b82-4bfa-9ec7-808a7c9753b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:49.026655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-08c4aecf-0b82-4bfa-9ec7-808a7c9753b2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:49.027930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-08c4aecf-0b82-4bfa-9ec7-808a7c9753b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:49.106620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:49.149341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 644/1322] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:49.436315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236fe53-6623-4ffe-a976-69e16d1b6c20 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:49.439230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4236fe53-6623-4ffe-a976-69e16d1b6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:49.477062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:49.591007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236fe53-6623-4ffe-a976-69e16d1b6c20 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:49.689815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af70aa-e215-47bf-bb43-b1c882f83d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:49.690485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af70aa-e215-47bf-bb43-b1c882f83d5f service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:49.690934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af70aa-e215-47bf-bb43-b1c882f83d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:49.691261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af70aa-e215-47bf-bb43-b1c882f83d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:49.693039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-97af70aa-e215-47bf-bb43-b1c882f83d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:49.771942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:49.816816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af70aa-e215-47bf-bb43-b1c882f83d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:49.818419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af70aa-e215-47bf-bb43-b1c882f83d5f service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:49.848585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 679/1323] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:51.884070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdd87-d70a-40c2-ad0a-22f6909a04c1 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:51.884799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdd87-d70a-40c2-ad0a-22f6909a04c1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:51.885050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdd87-d70a-40c2-ad0a-22f6909a04c1 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:51.886404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 645/1324] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:51.892197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498eba8-d043-4053-b39c-bf06afce8892 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:51.892644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498eba8-d043-4053-b39c-bf06afce8892 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:51.892899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498eba8-d043-4053-b39c-bf06afce8892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:51.983217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8498eba8-d043-4053-b39c-bf06afce8892 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:51.984386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8498eba8-d043-4053-b39c-bf06afce8892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:52.092416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 680/1325] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:52.382934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fdd87-d70a-40c2-ad0a-22f6909a04c1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:52.385600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-065fdd87-d70a-40c2-ad0a-22f6909a04c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:52.505893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fdd87-d70a-40c2-ad0a-22f6909a04c1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:52.584203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545ce21-5e63-45b1-8ba8-0c6952f3b927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:52.585033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ce21-5e63-45b1-8ba8-0c6952f3b927 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:52.585315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ce21-5e63-45b1-8ba8-0c6952f3b927 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:52.585595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ce21-5e63-45b1-8ba8-0c6952f3b927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:52.587261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6545ce21-5e63-45b1-8ba8-0c6952f3b927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:52.605920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:52.706546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545ce21-5e63-45b1-8ba8-0c6952f3b927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:52.708205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545ce21-5e63-45b1-8ba8-0c6952f3b927 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:52.727186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 646/1326] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:54.696107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382dc8-b168-450d-9785-e7d50837fd66 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:54.696633 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382dc8-b168-450d-9785-e7d50837fd66 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:54.696886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382dc8-b168-450d-9785-e7d50837fd66 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:54.698413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 681/1327] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:54.703687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b7bc-7212-453e-9841-df9a220139f7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:54.704103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b7bc-7212-453e-9841-df9a220139f7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:54.704358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b7bc-7212-453e-9841-df9a220139f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:54.771965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d747b7bc-7212-453e-9841-df9a220139f7 None None] MFA Rules not processed for user `37aa59325ec5426a8f56e75d1c2bbad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:54.773271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d747b7bc-7212-453e-9841-df9a220139f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:54.865857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:54.903591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 647/1328] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:55.194855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382dc8-b168-450d-9785-e7d50837fd66 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:55.197478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c4382dc8-b168-450d-9785-e7d50837fd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:55.231636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:55.313009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382dc8-b168-450d-9785-e7d50837fd66 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:55.398696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa0cac-fafb-4242-bf18-c57a0652a3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:55.399977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa0cac-fafb-4242-bf18-c57a0652a3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:55.400264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa0cac-fafb-4242-bf18-c57a0652a3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:55.400543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa0cac-fafb-4242-bf18-c57a0652a3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:55.402190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8efa0cac-fafb-4242-bf18-c57a0652a3a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:55.495886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:55.537000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa0cac-fafb-4242-bf18-c57a0652a3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:55.538894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa0cac-fafb-4242-bf18-c57a0652a3a4 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:55.562264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 682/1329] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:58.019089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81c73d-5a6c-4262-aeb4-ff3812e2eda9 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.019622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81c73d-5a6c-4262-aeb4-ff3812e2eda9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.019622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81c73d-5a6c-4262-aeb4-ff3812e2eda9 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.020906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 648/1330] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:58.027097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b005-9c58-4b45-846f-0f4097bf3b2b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.027521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b005-9c58-4b45-846f-0f4097bf3b2b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.027658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b005-9c58-4b45-846f-0f4097bf3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.095955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6920b005-9c58-4b45-846f-0f4097bf3b2b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:58.097191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6920b005-9c58-4b45-846f-0f4097bf3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.193959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 683/1331] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:58.492036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7491e7c-0d46-4d42-a208-bcb536bc649d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.492322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7491e7c-0d46-4d42-a208-bcb536bc649d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.492609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7491e7c-0d46-4d42-a208-bcb536bc649d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.494657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 649/1332] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 17 20:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:58.500501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a9c-0856-4a92-b830-e61334009800 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.500785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a9c-0856-4a92-b830-e61334009800 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.501062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a9c-0856-4a92-b830-e61334009800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.547984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:58.581467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-568b3a9c-0856-4a92-b830-e61334009800 None None] MFA Rules not processed for user `765ee8241c4e448eb999016b17132e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:58.582722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-568b3a9c-0856-4a92-b830-e61334009800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.661489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 684/1333] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 17 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:58.671187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7491e7c-0d46-4d42-a208-bcb536bc649d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:58.672714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c7491e7c-0d46-4d42-a208-bcb536bc649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.783265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7491e7c-0d46-4d42-a208-bcb536bc649d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:58.858227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1690a-c89e-4405-be6d-e13546a45a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:58.858871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1690a-c89e-4405-be6d-e13546a45a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.859145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1690a-c89e-4405-be6d-e13546a45a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.859418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1690a-c89e-4405-be6d-e13546a45a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.861034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e9a1690a-c89e-4405-be6d-e13546a45a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.890446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:58.975077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1690a-c89e-4405-be6d-e13546a45a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:58.976507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1690a-c89e-4405-be6d-e13546a45a60 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:58.996743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 650/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:01.199938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4eff9-b3d0-4a97-b27d-906dcb6bca74 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:01.200465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4eff9-b3d0-4a97-b27d-906dcb6bca74 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:01.200465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4eff9-b3d0-4a97-b27d-906dcb6bca74 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:01.201892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 685/1335] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:01.207492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a18ad-b6b9-488b-84a6-dee8a8b65fa4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:01.207993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a18ad-b6b9-488b-84a6-dee8a8b65fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:01.208098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a18ad-b6b9-488b-84a6-dee8a8b65fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:01.275381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ff7a18ad-b6b9-488b-84a6-dee8a8b65fa4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:01.276605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ff7a18ad-b6b9-488b-84a6-dee8a8b65fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:01.355169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:01.377579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 651/1336] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:01.672174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4eff9-b3d0-4a97-b27d-906dcb6bca74 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:01.673735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a7c4eff9-b3d0-4a97-b27d-906dcb6bca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:01.788875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4eff9-b3d0-4a97-b27d-906dcb6bca74 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:01.821803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:01.870890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4271da-bb45-457a-b204-d1faa7762a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:01.871501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4271da-bb45-457a-b204-d1faa7762a2e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:01.871786 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4271da-bb45-457a-b204-d1faa7762a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:01.872063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4271da-bb45-457a-b204-d1faa7762a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:01.873694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3a4271da-bb45-457a-b204-d1faa7762a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:01.988750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4271da-bb45-457a-b204-d1faa7762a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:01.990109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4271da-bb45-457a-b204-d1faa7762a2e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:02.009160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 686/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:04.922822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da25b5-b7a4-4090-a3e7-83b8a84c8383 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:04.923354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da25b5-b7a4-4090-a3e7-83b8a84c8383 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:04.923470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da25b5-b7a4-4090-a3e7-83b8a84c8383 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:04.924747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 652/1338] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:04.930468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8627e-a630-438d-8454-c6d00bd0f4fc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:04.931118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8627e-a630-438d-8454-c6d00bd0f4fc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:04.931118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8627e-a630-438d-8454-c6d00bd0f4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:04.997789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b7e8627e-a630-438d-8454-c6d00bd0f4fc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:04.999037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b7e8627e-a630-438d-8454-c6d00bd0f4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:05.007397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:05.109459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 687/1339] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:05.395277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da25b5-b7a4-4090-a3e7-83b8a84c8383 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:05.396834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-82da25b5-b7a4-4090-a3e7-83b8a84c8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:05.510315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da25b5-b7a4-4090-a3e7-83b8a84c8383 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:05.590040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3c6a1-48f8-4561-9703-2f55a395797f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:05.590668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c6a1-48f8-4561-9703-2f55a395797f service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:05.590960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c6a1-48f8-4561-9703-2f55a395797f service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:05.591231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c6a1-48f8-4561-9703-2f55a395797f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:05.592855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b2d3c6a1-48f8-4561-9703-2f55a395797f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:05.630160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:05.710008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3c6a1-48f8-4561-9703-2f55a395797f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:05.713023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3c6a1-48f8-4561-9703-2f55a395797f service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:05.732305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 653/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:09.990839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4852be9-5379-48a2-b96f-9111002eabc1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:09.991417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4852be9-5379-48a2-b96f-9111002eabc1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:09.991417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4852be9-5379-48a2-b96f-9111002eabc1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:09.994616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 688/1341] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:13:09.999330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015267d-f328-40ce-b149-35a9e6863275 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:09.999840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015267d-f328-40ce-b149-35a9e6863275 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:09.999934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015267d-f328-40ce-b149-35a9e6863275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:10.071549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2015267d-f328-40ce-b149-35a9e6863275 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:10.072816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2015267d-f328-40ce-b149-35a9e6863275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:10.165169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:10.176640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 654/1342] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:10.467536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4852be9-5379-48a2-b96f-9111002eabc1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:10.469155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c4852be9-5379-48a2-b96f-9111002eabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:10.590097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4852be9-5379-48a2-b96f-9111002eabc1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:10.631437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:10.674795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382fdb8-8ebc-409b-8b69-24a0eea44974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:10.674795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fdb8-8ebc-409b-8b69-24a0eea44974 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:10.674795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fdb8-8ebc-409b-8b69-24a0eea44974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:10.674795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fdb8-8ebc-409b-8b69-24a0eea44974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:10.675374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b382fdb8-8ebc-409b-8b69-24a0eea44974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:10.800490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382fdb8-8ebc-409b-8b69-24a0eea44974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:10.801781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382fdb8-8ebc-409b-8b69-24a0eea44974 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:10.821094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 689/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:13.822340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0753f74-78a3-495c-9110-75abb7d479f5 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:13.822944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0753f74-78a3-495c-9110-75abb7d479f5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:13.822944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0753f74-78a3-495c-9110-75abb7d479f5 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:13.824327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 655/1344] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:13.829925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd533ca-474f-42fe-9ffc-239304087e20 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:13.830408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd533ca-474f-42fe-9ffc-239304087e20 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:13.830515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd533ca-474f-42fe-9ffc-239304087e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:13.903558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-efd533ca-474f-42fe-9ffc-239304087e20 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:13.904801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-efd533ca-474f-42fe-9ffc-239304087e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:13.924031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:14.006534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 690/1345] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:14.294585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0753f74-78a3-495c-9110-75abb7d479f5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:14.296255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d0753f74-78a3-495c-9110-75abb7d479f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:14.408132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0753f74-78a3-495c-9110-75abb7d479f5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:14.487382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50451f1-3112-4300-8e18-f367dd1f34d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:14.487996 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50451f1-3112-4300-8e18-f367dd1f34d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:14.488275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50451f1-3112-4300-8e18-f367dd1f34d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:14.488546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50451f1-3112-4300-8e18-f367dd1f34d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:14.490153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f50451f1-3112-4300-8e18-f367dd1f34d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:14.659057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:14.740751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50451f1-3112-4300-8e18-f367dd1f34d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:14.742279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50451f1-3112-4300-8e18-f367dd1f34d3 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:14.765145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 656/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:19.051336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11640-e916-4356-b01f-ff6608a0671b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:19.051336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11640-e916-4356-b01f-ff6608a0671b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:19.051336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11640-e916-4356-b01f-ff6608a0671b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:19.053788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 691/1347] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:19.058328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbb6f3-7bd3-4439-8250-faa93051c753 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:19.058839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbb6f3-7bd3-4439-8250-faa93051c753 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:19.058959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbb6f3-7bd3-4439-8250-faa93051c753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:19.147013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4dbbb6f3-7bd3-4439-8250-faa93051c753 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:19.148256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4dbbb6f3-7bd3-4439-8250-faa93051c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:19.284043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:19.290780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 657/1348] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:19.606180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11640-e916-4356-b01f-ff6608a0671b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:19.607778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b7b11640-e916-4356-b01f-ff6608a0671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:19.728595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11640-e916-4356-b01f-ff6608a0671b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:19.785743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:19.815849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abcd3-218c-4195-a2c4-a4f3f9a8a939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:19.816373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abcd3-218c-4195-a2c4-a4f3f9a8a939 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:19.816655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abcd3-218c-4195-a2c4-a4f3f9a8a939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:19.817031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abcd3-218c-4195-a2c4-a4f3f9a8a939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:19.818783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-629abcd3-218c-4195-a2c4-a4f3f9a8a939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:19.937869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abcd3-218c-4195-a2c4-a4f3f9a8a939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:19.939256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abcd3-218c-4195-a2c4-a4f3f9a8a939 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:19.959753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 692/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:25.090465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1634f8f-8503-40cc-ab7e-43558ee88d60 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:25.091055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1634f8f-8503-40cc-ab7e-43558ee88d60 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:25.091360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1634f8f-8503-40cc-ab7e-43558ee88d60 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:25.093940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 658/1350] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:13:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:25.099959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae07b8e-eadd-4d42-886d-7213ef1b4e80 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:25.100425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae07b8e-eadd-4d42-886d-7213ef1b4e80 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:25.100516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae07b8e-eadd-4d42-886d-7213ef1b4e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:25.219062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8ae07b8e-eadd-4d42-886d-7213ef1b4e80 None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:25.221409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8ae07b8e-eadd-4d42-886d-7213ef1b4e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:25.251193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:25.425246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 693/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:30.349773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b11ac-467b-4c7c-9ee7-10a131a88756 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:30.350337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b11ac-467b-4c7c-9ee7-10a131a88756 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:30.350337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b11ac-467b-4c7c-9ee7-10a131a88756 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:30.352470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 659/1352] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:30.357910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3bea5-7682-4fef-b9f2-30787bccfc5d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:30.358439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3bea5-7682-4fef-b9f2-30787bccfc5d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:30.358524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3bea5-7682-4fef-b9f2-30787bccfc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:30.446777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4de3bea5-7682-4fef-b9f2-30787bccfc5d None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:30.448038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4de3bea5-7682-4fef-b9f2-30787bccfc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:30.549315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:30.590577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 694/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:13:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:32.146201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4513-f0e3-44a5-af2d-68b8eef7e71b None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:32.146782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4513-f0e3-44a5-af2d-68b8eef7e71b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:32.146782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4513-f0e3-44a5-af2d-68b8eef7e71b None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:32.149021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 660/1354] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:32.154595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b868b-dd85-4cfe-9784-b845c904be2e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:32.155238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b868b-dd85-4cfe-9784-b845c904be2e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:32.155360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b868b-dd85-4cfe-9784-b845c904be2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:32.246454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-418b868b-dd85-4cfe-9784-b845c904be2e None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:32.247703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-418b868b-dd85-4cfe-9784-b845c904be2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:32.378497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 695/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:13:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:35.711336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508d91-451a-4ded-99b0-d36e1dca6661 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:35.711902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508d91-451a-4ded-99b0-d36e1dca6661 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:35.711902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508d91-451a-4ded-99b0-d36e1dca6661 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:35.713135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 661/1356] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:35.718734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4c6f-fd66-4542-bd16-1454d7682648 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:35.719162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4c6f-fd66-4542-bd16-1454d7682648 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:35.719353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4c6f-fd66-4542-bd16-1454d7682648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:35.758254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:35.792736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-528c4c6f-fd66-4542-bd16-1454d7682648 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:35.793950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-528c4c6f-fd66-4542-bd16-1454d7682648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:35.917071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 696/1357] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:36.238952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33663d4d-fb22-4c3d-bdd6-58316557daf4 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:36.239325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33663d4d-fb22-4c3d-bdd6-58316557daf4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:36.239676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33663d4d-fb22-4c3d-bdd6-58316557daf4 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:36.241113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 662/1358] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 17 20:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:13:36.249249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9eb5-863a-4e3e-9d40-44503bbbe836 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:36.249550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9eb5-863a-4e3e-9d40-44503bbbe836 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:36.249835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9eb5-863a-4e3e-9d40-44503bbbe836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:36.353255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7cbd9eb5-863a-4e3e-9d40-44503bbbe836 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:36.354482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7cbd9eb5-863a-4e3e-9d40-44503bbbe836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:36.412940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:36.497637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 697/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 17 20:13:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:36.506614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33663d4d-fb22-4c3d-bdd6-58316557daf4 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:36.508496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-33663d4d-fb22-4c3d-bdd6-58316557daf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:36.690064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33663d4d-fb22-4c3d-bdd6-58316557daf4 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:36.779109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:36.827506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff67150-c6c9-46be-8e4b-d2bc59264166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:36.828922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67150-c6c9-46be-8e4b-d2bc59264166 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:36.829651 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67150-c6c9-46be-8e4b-d2bc59264166 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:36.830543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67150-c6c9-46be-8e4b-d2bc59264166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:36.832838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4ff67150-c6c9-46be-8e4b-d2bc59264166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:36.958246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff67150-c6c9-46be-8e4b-d2bc59264166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:36.961544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff67150-c6c9-46be-8e4b-d2bc59264166 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:36.989723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 663/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:39.281197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edf8d3-684a-40b3-835d-e55ab3cd0834 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:39.282051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edf8d3-684a-40b3-835d-e55ab3cd0834 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:39.282051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edf8d3-684a-40b3-835d-e55ab3cd0834 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:39.284444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 698/1361] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:39.290767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ea42-c962-411d-ad44-8cdf93df0668 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:39.291639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ea42-c962-411d-ad44-8cdf93df0668 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:39.291817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ea42-c962-411d-ad44-8cdf93df0668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:39.392953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2903ea42-c962-411d-ad44-8cdf93df0668 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:39.394202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2903ea42-c962-411d-ad44-8cdf93df0668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:39.446861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:39.524889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 664/1362] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:39.824895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edf8d3-684a-40b3-835d-e55ab3cd0834 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:39.828227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-76edf8d3-684a-40b3-835d-e55ab3cd0834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:40.025907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edf8d3-684a-40b3-835d-e55ab3cd0834 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:40.037841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:40.173241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b267f-8663-48c6-895f-7c53a947f4f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:40.173879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b267f-8663-48c6-895f-7c53a947f4f8 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:40.174172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b267f-8663-48c6-895f-7c53a947f4f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:40.174454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b267f-8663-48c6-895f-7c53a947f4f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:40.176268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7b9b267f-8663-48c6-895f-7c53a947f4f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:40.290221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b267f-8663-48c6-895f-7c53a947f4f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:40.291906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b267f-8663-48c6-895f-7c53a947f4f8 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:40.313066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 699/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:42.860727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d1034-8fd7-49cd-a9fa-5f1a7f9390c1 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:42.861522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d1034-8fd7-49cd-a9fa-5f1a7f9390c1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:42.861522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d1034-8fd7-49cd-a9fa-5f1a7f9390c1 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:42.862671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 665/1364] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:42.869357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032467d-4655-40e1-aea9-4f918e51d559 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:42.870029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032467d-4655-40e1-aea9-4f918e51d559 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:42.870029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032467d-4655-40e1-aea9-4f918e51d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:42.898450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:42.978325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f032467d-4655-40e1-aea9-4f918e51d559 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:42.980655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f032467d-4655-40e1-aea9-4f918e51d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:43.162702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 700/1365] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:43.515275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd825-d9b8-4218-837d-da401523043f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:43.515765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd825-d9b8-4218-837d-da401523043f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:43.516255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd825-d9b8-4218-837d-da401523043f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:43.518736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 666/1366] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 17 20:13:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:43.529438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943e3d-edde-4f8a-858a-f4577a199ff1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:43.530091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943e3d-edde-4f8a-858a-f4577a199ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:43.530477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943e3d-edde-4f8a-858a-f4577a199ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:43.623064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b4943e3d-edde-4f8a-858a-f4577a199ff1 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:43.624300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b4943e3d-edde-4f8a-858a-f4577a199ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:43.674587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:43.786576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 701/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 17 20:13:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:43.802293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fd825-d9b8-4218-837d-da401523043f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:43.806269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-159fd825-d9b8-4218-837d-da401523043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:44.106493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fd825-d9b8-4218-837d-da401523043f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:44.143965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:44.338518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b952d-614c-44e4-ad44-db863de344d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:44.339612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b952d-614c-44e4-ad44-db863de344d2 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:44.340429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b952d-614c-44e4-ad44-db863de344d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:44.340719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b952d-614c-44e4-ad44-db863de344d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:44.342667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b86b952d-614c-44e4-ad44-db863de344d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:44.530721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b952d-614c-44e4-ad44-db863de344d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:44.532256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b952d-614c-44e4-ad44-db863de344d2 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:44.558447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 667/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:45.314415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de6134-ea03-4aac-bf6f-1bf44bf00f2f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:45.315237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de6134-ea03-4aac-bf6f-1bf44bf00f2f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:45.315659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de6134-ea03-4aac-bf6f-1bf44bf00f2f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:45.318229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 702/1369] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:45.325626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab3ea-f962-4fab-9729-07a04ab5720f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:45.326390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab3ea-f962-4fab-9729-07a04ab5720f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:45.326390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab3ea-f962-4fab-9729-07a04ab5720f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:45.375660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:45.425659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6b1ab3ea-f962-4fab-9729-07a04ab5720f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:45.427247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6b1ab3ea-f962-4fab-9729-07a04ab5720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:45.568724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 668/1370] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:13:46.142789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea30f-3bf8-4e71-84b7-7e7906c2c8a6 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:46.143456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea30f-3bf8-4e71-84b7-7e7906c2c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:46.143739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea30f-3bf8-4e71-84b7-7e7906c2c8a6 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:46.146399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 703/1371] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 17 20:13:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:46.155809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f6a8-8748-4d9b-83de-f02d1be8477b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:46.156301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f6a8-8748-4d9b-83de-f02d1be8477b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:46.156845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f6a8-8748-4d9b-83de-f02d1be8477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:46.298566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a0f0f6a8-8748-4d9b-83de-f02d1be8477b None None] MFA Rules not processed for user `0ac7372634fa47df8d7fb36c98f7e0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:46.300647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a0f0f6a8-8748-4d9b-83de-f02d1be8477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:46.368724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:46.418205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 669/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 17 20:13:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:46.426118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea30f-3bf8-4e71-84b7-7e7906c2c8a6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:46.427810 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-445ea30f-3bf8-4e71-84b7-7e7906c2c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:46.546541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea30f-3bf8-4e71-84b7-7e7906c2c8a6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:46.593836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:46.644696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a3ed7-ab71-4e39-8c28-4cb3da1dfeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:46.645346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3ed7-ab71-4e39-8c28-4cb3da1dfeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:46.645613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3ed7-ab71-4e39-8c28-4cb3da1dfeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:46.645891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3ed7-ab71-4e39-8c28-4cb3da1dfeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:46.647826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f5a3ed7-ab71-4e39-8c28-4cb3da1dfeb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:46.777902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a3ed7-ab71-4e39-8c28-4cb3da1dfeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:46.779378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a3ed7-ab71-4e39-8c28-4cb3da1dfeb5 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:46.801610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 704/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:47.247001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3de70-03cd-4768-a8c1-83505c15d9e1 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:47.247001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3de70-03cd-4768-a8c1-83505c15d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:47.247001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3de70-03cd-4768-a8c1-83505c15d9e1 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:47.248591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 670/1374] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:47.254660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1723b-e81f-4317-9f71-cd6c21eadb87 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:47.254978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1723b-e81f-4317-9f71-cd6c21eadb87 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:47.255439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1723b-e81f-4317-9f71-cd6c21eadb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:47.329734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cdc1723b-e81f-4317-9f71-cd6c21eadb87 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:47.330983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cdc1723b-e81f-4317-9f71-cd6c21eadb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:47.353872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:47.470798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 705/1375] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:13:47.759111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3de70-03cd-4768-a8c1-83505c15d9e1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:47.760693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4fe3de70-03cd-4768-a8c1-83505c15d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:47.938759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3de70-03cd-4768-a8c1-83505c15d9e1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:47.996080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:48.067004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c170b-7dde-4a35-9983-b7cd54a14e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:48.067616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c170b-7dde-4a35-9983-b7cd54a14e18 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:48.067889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c170b-7dde-4a35-9983-b7cd54a14e18 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:48.068155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c170b-7dde-4a35-9983-b7cd54a14e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:48.070171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-af2c170b-7dde-4a35-9983-b7cd54a14e18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:48.169829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c170b-7dde-4a35-9983-b7cd54a14e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:48.172864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c170b-7dde-4a35-9983-b7cd54a14e18 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:48.199713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 671/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:50.460567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ff95-a637-48ea-bdf4-254f19f243b2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:50.461092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ff95-a637-48ea-bdf4-254f19f243b2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:50.461092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ff95-a637-48ea-bdf4-254f19f243b2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:50.462375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 706/1377] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:50.468109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e25fa-75d7-46a3-a2be-b27cac97b088 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:50.468723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e25fa-75d7-46a3-a2be-b27cac97b088 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:50.468723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e25fa-75d7-46a3-a2be-b27cac97b088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:50.542005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9f5e25fa-75d7-46a3-a2be-b27cac97b088 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:50.543246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9f5e25fa-75d7-46a3-a2be-b27cac97b088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:50.550612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:50.658573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 672/1378] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:50.963342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ff95-a637-48ea-bdf4-254f19f243b2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:50.965324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1c56ff95-a637-48ea-bdf4-254f19f243b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:51.215031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ff95-a637-48ea-bdf4-254f19f243b2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:51.222731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:51.472482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2975a-40cb-4fef-b0d2-55a1d4ed38d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:51.473446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2975a-40cb-4fef-b0d2-55a1d4ed38d7 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:51.473958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2975a-40cb-4fef-b0d2-55a1d4ed38d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:51.474465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2975a-40cb-4fef-b0d2-55a1d4ed38d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:51.478314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-98b2975a-40cb-4fef-b0d2-55a1d4ed38d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:51.656938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2975a-40cb-4fef-b0d2-55a1d4ed38d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:51.658494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2975a-40cb-4fef-b0d2-55a1d4ed38d7 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:51.680847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 707/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:53.975757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6f626-657b-45b2-b6d8-516e32d08cd2 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:53.976694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6f626-657b-45b2-b6d8-516e32d08cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:53.976694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6f626-657b-45b2-b6d8-516e32d08cd2 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:53.983797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 673/1380] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:53.984241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700245d4-e463-49b4-a2d8-636eb9961ccc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:53.984705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700245d4-e463-49b4-a2d8-636eb9961ccc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:53.984798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700245d4-e463-49b4-a2d8-636eb9961ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:53.998468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:54.063356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-700245d4-e463-49b4-a2d8-636eb9961ccc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:54.064570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-700245d4-e463-49b4-a2d8-636eb9961ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:54.182300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 708/1381] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:13:54.504773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6f626-657b-45b2-b6d8-516e32d08cd2 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:54.506684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b2a6f626-657b-45b2-b6d8-516e32d08cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:54.723880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:54.744666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6f626-657b-45b2-b6d8-516e32d08cd2 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:54.960983 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979975f-30c1-495f-a53a-0ccc8842032a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:54.961994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979975f-30c1-495f-a53a-0ccc8842032a service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:54.962469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979975f-30c1-495f-a53a-0ccc8842032a service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:54.963014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979975f-30c1-495f-a53a-0ccc8842032a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:54.965999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d979975f-30c1-495f-a53a-0ccc8842032a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:55.127541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979975f-30c1-495f-a53a-0ccc8842032a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:55.130613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979975f-30c1-495f-a53a-0ccc8842032a service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:55.152473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:55.167076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 674/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:57.407482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebdcec-a210-4c85-9d72-112bc188ad71 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:57.408133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebdcec-a210-4c85-9d72-112bc188ad71 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:57.408133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebdcec-a210-4c85-9d72-112bc188ad71 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:57.409422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 709/1383] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:57.415784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2d64-4834-42b9-80c4-3ff5dd326b3e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:57.416282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2d64-4834-42b9-80c4-3ff5dd326b3e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:57.416282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2d64-4834-42b9-80c4-3ff5dd326b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:57.490450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-471f2d64-4834-42b9-80c4-3ff5dd326b3e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:57.492735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-471f2d64-4834-42b9-80c4-3ff5dd326b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:57.635150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 675/1384] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:57.934454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebdcec-a210-4c85-9d72-112bc188ad71 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:57.936011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-29ebdcec-a210-4c85-9d72-112bc188ad71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:58.041996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:58.119315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebdcec-a210-4c85-9d72-112bc188ad71 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:58.314843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9e1e9-e8e4-4eb2-8c2e-6aa9e235f8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:58.316203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1e9-e8e4-4eb2-8c2e-6aa9e235f8f1 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:58.316203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1e9-e8e4-4eb2-8c2e-6aa9e235f8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:58.316203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1e9-e8e4-4eb2-8c2e-6aa9e235f8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:58.318091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-40d9e1e9-e8e4-4eb2-8c2e-6aa9e235f8f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:58.390424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:58.451425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1e9-e8e4-4eb2-8c2e-6aa9e235f8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:58.453667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1e9-e8e4-4eb2-8c2e-6aa9e235f8f1 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:58.478894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 710/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:01.766852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd05af-4baa-49a2-9e36-5a136d1956ba None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:01.767581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd05af-4baa-49a2-9e36-5a136d1956ba None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:01.767841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd05af-4baa-49a2-9e36-5a136d1956ba None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:01.770150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 676/1386] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:14:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:01.776996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02ea44-48b6-4af3-b145-0fa5d09bacf8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:01.777679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02ea44-48b6-4af3-b145-0fa5d09bacf8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:01.777813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02ea44-48b6-4af3-b145-0fa5d09bacf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:01.861105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8c02ea44-48b6-4af3-b145-0fa5d09bacf8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:01.862340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8c02ea44-48b6-4af3-b145-0fa5d09bacf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:01.967026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 711/1387] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:02.265967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd05af-4baa-49a2-9e36-5a136d1956ba None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:02.267570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b0cd05af-4baa-49a2-9e36-5a136d1956ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:02.353888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:02.433596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd05af-4baa-49a2-9e36-5a136d1956ba None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:02.593230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f055-ecb8-44dd-b9f2-aa7f229873af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:02.593855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f055-ecb8-44dd-b9f2-aa7f229873af service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:02.594141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f055-ecb8-44dd-b9f2-aa7f229873af service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:02.594421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f055-ecb8-44dd-b9f2-aa7f229873af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:02.596179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6594f055-ecb8-44dd-b9f2-aa7f229873af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:02.644309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:02.705087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f055-ecb8-44dd-b9f2-aa7f229873af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:02.706766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f055-ecb8-44dd-b9f2-aa7f229873af service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:02.731450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 677/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:03.107337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0044-eb6d-4e29-abac-a55167c00e40 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:03.108003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0044-eb6d-4e29-abac-a55167c00e40 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:03.108003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0044-eb6d-4e29-abac-a55167c00e40 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:03.109229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 712/1389] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:03.115081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9ee1-08ff-48ae-b48b-349e2f04f4fe None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:03.116117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9ee1-08ff-48ae-b48b-349e2f04f4fe None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:03.117001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9ee1-08ff-48ae-b48b-349e2f04f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:03.196043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ad7d9ee1-08ff-48ae-b48b-349e2f04f4fe None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:03.197265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ad7d9ee1-08ff-48ae-b48b-349e2f04f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:03.301688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 678/1390] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:03.607523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016c5fa-0030-44d7-a6e1-7fc90ee7495d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:03.607806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016c5fa-0030-44d7-a6e1-7fc90ee7495d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:03.608076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016c5fa-0030-44d7-a6e1-7fc90ee7495d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:03.609503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 713/1391] 10.222.0.64 () {54 vars in 967 bytes} [Wed Aug 17 20:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:03.614870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183af4b-b9ed-4fbc-bcb3-0e45be56fb7d None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:03.615198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183af4b-b9ed-4fbc-bcb3-0e45be56fb7d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:03.616032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183af4b-b9ed-4fbc-bcb3-0e45be56fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:03.633606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:03.703543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2183af4b-b9ed-4fbc-bcb3-0e45be56fb7d None None] MFA Rules not processed for user `6e3e10f9efeb4b908bf3d74ce1eb6a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:03.704781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2183af4b-b9ed-4fbc-bcb3-0e45be56fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:03.794836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 679/1392] 10.222.0.64 () {58 vars in 1064 bytes} [Wed Aug 17 20:14:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:03.805074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016c5fa-0030-44d7-a6e1-7fc90ee7495d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:03.806915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0016c5fa-0030-44d7-a6e1-7fc90ee7495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:03.853947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:03.934776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016c5fa-0030-44d7-a6e1-7fc90ee7495d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:04.014601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ae8a-7421-4711-ba64-0e5b1cee4591 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e3e10f9efeb4b908bf3d74ce1eb6a3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:04.015289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ae8a-7421-4711-ba64-0e5b1cee4591 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:04.015577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ae8a-7421-4711-ba64-0e5b1cee4591 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:04.015861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ae8a-7421-4711-ba64-0e5b1cee4591 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:04.017495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4e02ae8a-7421-4711-ba64-0e5b1cee4591 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:04.103026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:04.137335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02ae8a-7421-4711-ba64-0e5b1cee4591 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:04.138732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02ae8a-7421-4711-ba64-0e5b1cee4591 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:04.157639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 714/1393] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:14:04.893516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4fd47-a85f-479c-87cb-84e4aa457a3b None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:04.894092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4fd47-a85f-479c-87cb-84e4aa457a3b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:04.894092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4fd47-a85f-479c-87cb-84e4aa457a3b None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:04.895439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 680/1394] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:04.905231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aad5c9-5d72-4967-8e57-bd66f8683c26 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:04.905721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aad5c9-5d72-4967-8e57-bd66f8683c26 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:04.906199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aad5c9-5d72-4967-8e57-bd66f8683c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:04.988273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-33aad5c9-5d72-4967-8e57-bd66f8683c26 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:04.989564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33aad5c9-5d72-4967-8e57-bd66f8683c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:05.105560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f99c-ab42-4e69-8fce-4a36a6717aed None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:05.105871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f99c-ab42-4e69-8fce-4a36a6717aed None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:05.106153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f99c-ab42-4e69-8fce-4a36a6717aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:05.107550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 715/1395] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:05.187732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ccd1f99c-ab42-4e69-8fce-4a36a6717aed None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:05.188973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ccd1f99c-ab42-4e69-8fce-4a36a6717aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:05.261716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:05.299236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 681/1396] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:05.357741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dc796-6702-4fb2-9d28-ff79469d8ddd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:05.358666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dc796-6702-4fb2-9d28-ff79469d8ddd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:05.359149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dc796-6702-4fb2-9d28-ff79469d8ddd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:05.360725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 716/1397] 10.222.0.64 () {54 vars in 943 bytes} [Wed Aug 17 20:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:05.369576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c671-b25a-41e4-8e6d-4e248c909bb7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:05.370802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c671-b25a-41e4-8e6d-4e248c909bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:05.370802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c671-b25a-41e4-8e6d-4e248c909bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:05.407171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dc796-6702-4fb2-9d28-ff79469d8ddd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:05.408672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-563dc796-6702-4fb2-9d28-ff79469d8ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:05.458795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:05.470757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3b01c671-b25a-41e4-8e6d-4e248c909bb7 None None] MFA Rules not processed for user `fc0c376af51e4b5195da5ff453026ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:05.472044 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3b01c671-b25a-41e4-8e6d-4e248c909bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:05.595486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dc796-6702-4fb2-9d28-ff79469d8ddd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:05.596589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 682/1398] 10.222.0.64 () {58 vars in 1040 bytes} [Wed Aug 17 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:05.611514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c671-b25a-41e4-8e6d-4e248c909bb7 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:05.622724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c671-b25a-41e4-8e6d-4e248c909bb7 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:05.650479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:05.736086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:05.740158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c487f9-ed33-4c25-a76a-96e454ad04be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:05.740412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087d484-9981-4939-b65b-c20627a01eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:05.740867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c487f9-ed33-4c25-a76a-96e454ad04be service swift] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:05.741013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d484-9981-4939-b65b-c20627a01eb7 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:05.741328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d484-9981-4939-b65b-c20627a01eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:05.741443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c487f9-ed33-4c25-a76a-96e454ad04be service swift] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:05.741568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c487f9-ed33-4c25-a76a-96e454ad04be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:05.741679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d484-9981-4939-b65b-c20627a01eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:05.743430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d8c487f9-ed33-4c25-a76a-96e454ad04be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:05.752814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b087d484-9981-4939-b65b-c20627a01eb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:05.847321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087d484-9981-4939-b65b-c20627a01eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:05.848963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087d484-9981-4939-b65b-c20627a01eb7 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:05.859629 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c487f9-ed33-4c25-a76a-96e454ad04be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:05.861254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c487f9-ed33-4c25-a76a-96e454ad04be service swift] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:05.869696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 717/1399] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:14:05.870875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 683/1400] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:14:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 20:14:08.374703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d50a3-5029-43da-90ac-038e14802521 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:08.375546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d50a3-5029-43da-90ac-038e14802521 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:08.375710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d50a3-5029-43da-90ac-038e14802521 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:08.387682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 718/1401] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:14:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:08.395563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c385b-4948-4db2-916f-a019d23fd944 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:08.396397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c385b-4948-4db2-916f-a019d23fd944 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:08.397524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c385b-4948-4db2-916f-a019d23fd944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:08.531261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e72c385b-4948-4db2-916f-a019d23fd944 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:08.532592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e72c385b-4948-4db2-916f-a019d23fd944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:08.542867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:08.680592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 684/1402] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:09.016804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d50a3-5029-43da-90ac-038e14802521 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:09.073203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-620d50a3-5029-43da-90ac-038e14802521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:09.273288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:09.336798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d50a3-5029-43da-90ac-038e14802521 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:09.566467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511244e-7e2a-4615-a81e-382757a62055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:09.567861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511244e-7e2a-4615-a81e-382757a62055 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:09.568350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511244e-7e2a-4615-a81e-382757a62055 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:09.568791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511244e-7e2a-4615-a81e-382757a62055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:09.571614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f511244e-7e2a-4615-a81e-382757a62055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:09.708308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:09.728524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511244e-7e2a-4615-a81e-382757a62055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:09.730482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511244e-7e2a-4615-a81e-382757a62055 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:09.755337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 719/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:12.104175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd51e1-be9b-44d4-8d48-dd2fde1aa592 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:12.104748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd51e1-be9b-44d4-8d48-dd2fde1aa592 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:12.104748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd51e1-be9b-44d4-8d48-dd2fde1aa592 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:12.106239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 685/1404] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:12.114109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc373-84ab-4480-9ffa-fb5f58fe17e7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:12.114109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc373-84ab-4480-9ffa-fb5f58fe17e7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:12.114109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc373-84ab-4480-9ffa-fb5f58fe17e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:12.191517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d56fc373-84ab-4480-9ffa-fb5f58fe17e7 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:12.192918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d56fc373-84ab-4480-9ffa-fb5f58fe17e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:12.338705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 720/1405] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:12.635104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd51e1-be9b-44d4-8d48-dd2fde1aa592 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:12.635104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a9bd51e1-be9b-44d4-8d48-dd2fde1aa592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:12.842774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:12.855357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd51e1-be9b-44d4-8d48-dd2fde1aa592 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:13.011077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb22f9-4c73-4c3f-bc4f-2de331674818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:13.011735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb22f9-4c73-4c3f-bc4f-2de331674818 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:13.012028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb22f9-4c73-4c3f-bc4f-2de331674818 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:13.012319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb22f9-4c73-4c3f-bc4f-2de331674818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:13.014584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1ffb22f9-4c73-4c3f-bc4f-2de331674818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:13.120488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb22f9-4c73-4c3f-bc4f-2de331674818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:13.122238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb22f9-4c73-4c3f-bc4f-2de331674818 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:13.134053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:13.145355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 686/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:15.671421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef38625-3969-497a-93bd-4b4f497d378c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:15.671948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef38625-3969-497a-93bd-4b4f497d378c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:15.671948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef38625-3969-497a-93bd-4b4f497d378c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:15.673244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 721/1407] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:14:15.684968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cdf2f-cca6-4d46-9ae6-91c2b734bdc6 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:15.685616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cdf2f-cca6-4d46-9ae6-91c2b734bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:15.685616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cdf2f-cca6-4d46-9ae6-91c2b734bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:15.759286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-104cdf2f-cca6-4d46-9ae6-91c2b734bdc6 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:15.759753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-104cdf2f-cca6-4d46-9ae6-91c2b734bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:15.894881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 687/1408] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:16.189609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef38625-3969-497a-93bd-4b4f497d378c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:16.191298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cef38625-3969-497a-93bd-4b4f497d378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:16.284564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:16.386984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef38625-3969-497a-93bd-4b4f497d378c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:16.525651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f618c-1c53-4daf-8924-113c7d25b284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:16.526179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f618c-1c53-4daf-8924-113c7d25b284 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:16.526478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f618c-1c53-4daf-8924-113c7d25b284 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:16.526765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f618c-1c53-4daf-8924-113c7d25b284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:16.528413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d19f618c-1c53-4daf-8924-113c7d25b284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:16.566656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:16.661560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f618c-1c53-4daf-8924-113c7d25b284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:16.664088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f618c-1c53-4daf-8924-113c7d25b284 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:16.692524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 722/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:14:25.885846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=67 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:26.689783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=35 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:30.495177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40aded-9c31-4103-8a6c-0032ada0ca97 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:30.495993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40aded-9c31-4103-8a6c-0032ada0ca97 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:30.495993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40aded-9c31-4103-8a6c-0032ada0ca97 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:30.497139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 688/1410] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 17 20:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:30.503510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25975-f25c-4fef-b2f6-296313e077b4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:30.503988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25975-f25c-4fef-b2f6-296313e077b4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:30.504095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25975-f25c-4fef-b2f6-296313e077b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:30.591045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-39a25975-f25c-4fef-b2f6-296313e077b4 None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:30.592316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-39a25975-f25c-4fef-b2f6-296313e077b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:30.708022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 723/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 17 20:14:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:30.727196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5169-a95a-410d-9a2b-0ec2f611a59d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:30.727196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5169-a95a-410d-9a2b-0ec2f611a59d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:30.727196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5169-a95a-410d-9a2b-0ec2f611a59d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:30.727196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 689/1412] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 17 20:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:30.731802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987e9f-e4ac-4b9f-966f-f82d03b14d76 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:30.732097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987e9f-e4ac-4b9f-966f-f82d03b14d76 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:30.732373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15987e9f-e4ac-4b9f-966f-f82d03b14d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:30.814565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:30.817598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-15987e9f-e4ac-4b9f-966f-f82d03b14d76 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:30.818880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-15987e9f-e4ac-4b9f-966f-f82d03b14d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:30.949112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 724/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 17 20:14:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:33.430520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfa45-b20a-4c26-8e41-bd022dacc7e6 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:33.431126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfa45-b20a-4c26-8e41-bd022dacc7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:33.431126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfa45-b20a-4c26-8e41-bd022dacc7e6 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:33.432526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 690/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:33.441655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82abf3a-2ae8-4b51-9acd-4bef58238963 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:33.442178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82abf3a-2ae8-4b51-9acd-4bef58238963 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:33.443179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82abf3a-2ae8-4b51-9acd-4bef58238963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:33.519338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d82abf3a-2ae8-4b51-9acd-4bef58238963 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:33.521287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d82abf3a-2ae8-4b51-9acd-4bef58238963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:33.580341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:33.634486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 725/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:33.928092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cfa45-b20a-4c26-8e41-bd022dacc7e6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:33.930522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2c6cfa45-b20a-4c26-8e41-bd022dacc7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:34.090520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cfa45-b20a-4c26-8e41-bd022dacc7e6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:34.177082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:34.223007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23842f-dffa-4816-b06b-ac77f26ec102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:34.223932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23842f-dffa-4816-b06b-ac77f26ec102 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:34.224386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23842f-dffa-4816-b06b-ac77f26ec102 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:34.224661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23842f-dffa-4816-b06b-ac77f26ec102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:34.226300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1b23842f-dffa-4816-b06b-ac77f26ec102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:34.323823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23842f-dffa-4816-b06b-ac77f26ec102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:34.325454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23842f-dffa-4816-b06b-ac77f26ec102 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:34.344976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 691/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:35.273617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bc062-5cb1-4f35-83bf-a464c4f520c7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:35.280359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bc062-5cb1-4f35-83bf-a464c4f520c7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:35.280359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bc062-5cb1-4f35-83bf-a464c4f520c7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:35.280359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 726/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:35.281827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a6e3-77b7-48db-b60d-180a47d146fd None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:35.282268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a6e3-77b7-48db-b60d-180a47d146fd None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:35.282372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a6e3-77b7-48db-b60d-180a47d146fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:35.366808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5084a6e3-77b7-48db-b60d-180a47d146fd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:35.368060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5084a6e3-77b7-48db-b60d-180a47d146fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:35.406081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:35.475028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 692/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:35.625660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bc062-5cb1-4f35-83bf-a464c4f520c7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:35.627638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-444bc062-5cb1-4f35-83bf-a464c4f520c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:35.781503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bc062-5cb1-4f35-83bf-a464c4f520c7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:35.823292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:35.900596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f9bf-b959-4117-9d8b-1a225cb63f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:35.901205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f9bf-b959-4117-9d8b-1a225cb63f49 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:35.901483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f9bf-b959-4117-9d8b-1a225cb63f49 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:35.901756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f9bf-b959-4117-9d8b-1a225cb63f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:35.903475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ba44f9bf-b959-4117-9d8b-1a225cb63f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:36.001548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f9bf-b959-4117-9d8b-1a225cb63f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:36.003181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f9bf-b959-4117-9d8b-1a225cb63f49 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:36.026278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 727/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:36.977992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196edce-3544-494e-9052-ae16eb02af48 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:36.978551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196edce-3544-494e-9052-ae16eb02af48 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:36.978551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196edce-3544-494e-9052-ae16eb02af48 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:36.979864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 693/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:36.985163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7d86-ed1d-4752-bf82-0b54c2d19a05 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:36.985635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7d86-ed1d-4752-bf82-0b54c2d19a05 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:36.985743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7d86-ed1d-4752-bf82-0b54c2d19a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:37.044931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:37.068682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-023c7d86-ed1d-4752-bf82-0b54c2d19a05 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:37.069930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-023c7d86-ed1d-4752-bf82-0b54c2d19a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:37.174169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 728/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:37.329518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196edce-3544-494e-9052-ae16eb02af48 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:37.330987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f196edce-3544-494e-9052-ae16eb02af48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:37.482398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196edce-3544-494e-9052-ae16eb02af48 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:37.495976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:37.605773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5491f13-03d2-4ccb-be3a-a45216b87c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:37.606388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491f13-03d2-4ccb-be3a-a45216b87c50 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:37.606710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491f13-03d2-4ccb-be3a-a45216b87c50 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:37.606987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491f13-03d2-4ccb-be3a-a45216b87c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:37.608611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c5491f13-03d2-4ccb-be3a-a45216b87c50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:37.709581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5491f13-03d2-4ccb-be3a-a45216b87c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:37.711234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5491f13-03d2-4ccb-be3a-a45216b87c50 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:37.730314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 694/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:38.627915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757a52-16a4-4140-95bb-96e46395326e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:38.628507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757a52-16a4-4140-95bb-96e46395326e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:38.628507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757a52-16a4-4140-95bb-96e46395326e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:38.630429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 729/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:38.636390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa755c5-bf29-455f-b795-4380849f1ccc None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:38.636976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa755c5-bf29-455f-b795-4380849f1ccc None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:38.636976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa755c5-bf29-455f-b795-4380849f1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:38.659447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:38.725200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6aa755c5-bf29-455f-b795-4380849f1ccc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:38.726476 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6aa755c5-bf29-455f-b795-4380849f1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:38.831219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 695/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:38.982299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75757a52-16a4-4140-95bb-96e46395326e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:38.983881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-75757a52-16a4-4140-95bb-96e46395326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:39.105500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:39.144745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75757a52-16a4-4140-95bb-96e46395326e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:39.263412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee399a1b-bbce-4dbd-a851-a13164867dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:39.264043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399a1b-bbce-4dbd-a851-a13164867dc1 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:39.264231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399a1b-bbce-4dbd-a851-a13164867dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:39.264505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399a1b-bbce-4dbd-a851-a13164867dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:39.266139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ee399a1b-bbce-4dbd-a851-a13164867dc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:39.345336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:39.362566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee399a1b-bbce-4dbd-a851-a13164867dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:39.364249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee399a1b-bbce-4dbd-a851-a13164867dc1 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:39.384950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 730/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:40.261900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ae70-7aeb-4107-9b9a-c2c745c8102d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:40.262510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ae70-7aeb-4107-9b9a-c2c745c8102d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:40.262510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ae70-7aeb-4107-9b9a-c2c745c8102d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:40.264082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 696/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:40.269069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e03838-9d90-4b75-b486-c82fdc296fcd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:40.269533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e03838-9d90-4b75-b486-c82fdc296fcd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:40.269650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e03838-9d90-4b75-b486-c82fdc296fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:40.349470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-21e03838-9d90-4b75-b486-c82fdc296fcd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:40.350743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-21e03838-9d90-4b75-b486-c82fdc296fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:40.450771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 731/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:40.604245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ae70-7aeb-4107-9b9a-c2c745c8102d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:40.605753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2700ae70-7aeb-4107-9b9a-c2c745c8102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:40.692859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:40.758328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ae70-7aeb-4107-9b9a-c2c745c8102d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:40.883453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965a64-23a5-4d3b-81bb-7bc655ec1bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:40.883987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965a64-23a5-4d3b-81bb-7bc655ec1bcc service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:40.884269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965a64-23a5-4d3b-81bb-7bc655ec1bcc service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:40.884544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965a64-23a5-4d3b-81bb-7bc655ec1bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:40.886239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-95965a64-23a5-4d3b-81bb-7bc655ec1bcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:40.944638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:40.990115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965a64-23a5-4d3b-81bb-7bc655ec1bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:40.991778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965a64-23a5-4d3b-81bb-7bc655ec1bcc service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:41.012278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 697/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:41.913057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acdca1-4d77-40d1-ab4b-ea7207adeb00 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:41.913631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acdca1-4d77-40d1-ab4b-ea7207adeb00 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:41.913631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acdca1-4d77-40d1-ab4b-ea7207adeb00 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:41.914977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 732/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:41.920196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5898a-75d0-49fa-b7f8-3c08c0ce4318 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:41.920707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5898a-75d0-49fa-b7f8-3c08c0ce4318 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:41.920810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5898a-75d0-49fa-b7f8-3c08c0ce4318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:42.011140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-dad5898a-75d0-49fa-b7f8-3c08c0ce4318 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:42.012396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-dad5898a-75d0-49fa-b7f8-3c08c0ce4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:42.112793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 698/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:42.271526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acdca1-4d77-40d1-ab4b-ea7207adeb00 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:42.273103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-97acdca1-4d77-40d1-ab4b-ea7207adeb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:42.329828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:42.447578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acdca1-4d77-40d1-ab4b-ea7207adeb00 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:42.565692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731102bd-b091-4901-b093-8fd429d7220d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:42.566230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731102bd-b091-4901-b093-8fd429d7220d service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:42.566512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731102bd-b091-4901-b093-8fd429d7220d service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:42.566826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731102bd-b091-4901-b093-8fd429d7220d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:42.568513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-731102bd-b091-4901-b093-8fd429d7220d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:42.575908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:42.664359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731102bd-b091-4901-b093-8fd429d7220d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:42.665964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731102bd-b091-4901-b093-8fd429d7220d service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:42.685808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 733/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:43.567787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9834-b1ce-4f91-bd71-86a89ea7357c None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:43.568402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9834-b1ce-4f91-bd71-86a89ea7357c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:43.568402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9834-b1ce-4f91-bd71-86a89ea7357c None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:43.569656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 699/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:43.574864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1470ca4-2e25-4bf5-8e00-93b10c8f2724 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:43.575291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1470ca4-2e25-4bf5-8e00-93b10c8f2724 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:43.575412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1470ca4-2e25-4bf5-8e00-93b10c8f2724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:43.652375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c1470ca4-2e25-4bf5-8e00-93b10c8f2724 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:43.653595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c1470ca4-2e25-4bf5-8e00-93b10c8f2724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:43.723930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:43.752851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 734/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:43.907665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b9834-b1ce-4f91-bd71-86a89ea7357c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:43.909236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-051b9834-b1ce-4f91-bd71-86a89ea7357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:43.928784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:44.059247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b9834-b1ce-4f91-bd71-86a89ea7357c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:44.147154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:44.173381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43e1bb-afc0-44f9-9356-ef6d41486e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:44.173906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e1bb-afc0-44f9-9356-ef6d41486e9f service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:44.174189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e1bb-afc0-44f9-9356-ef6d41486e9f service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:44.174466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e1bb-afc0-44f9-9356-ef6d41486e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:44.176130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1a43e1bb-afc0-44f9-9356-ef6d41486e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:44.268310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43e1bb-afc0-44f9-9356-ef6d41486e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:44.269941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43e1bb-afc0-44f9-9356-ef6d41486e9f service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:44.290134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 700/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:45.172518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aefaa3-b233-4b37-abb6-006267f32a13 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:45.173039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aefaa3-b233-4b37-abb6-006267f32a13 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:45.173153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aefaa3-b233-4b37-abb6-006267f32a13 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:45.174421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 735/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:45.180061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777a829-b457-4633-8766-6bbe3759b5ce None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:45.180518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777a829-b457-4633-8766-6bbe3759b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:45.180624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777a829-b457-4633-8766-6bbe3759b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:45.259233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0777a829-b457-4633-8766-6bbe3759b5ce None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:45.260557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0777a829-b457-4633-8766-6bbe3759b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:45.305196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:45.368453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 701/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:45.523181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aefaa3-b233-4b37-abb6-006267f32a13 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:45.524700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d5aefaa3-b233-4b37-abb6-006267f32a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:45.673422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aefaa3-b233-4b37-abb6-006267f32a13 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:45.729622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:45.790305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30299112-b28b-429f-a7d8-6112d4af4c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:45.791294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299112-b28b-429f-a7d8-6112d4af4c60 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:45.791294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299112-b28b-429f-a7d8-6112d4af4c60 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:45.791626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299112-b28b-429f-a7d8-6112d4af4c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:45.793569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-30299112-b28b-429f-a7d8-6112d4af4c60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:45.905776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30299112-b28b-429f-a7d8-6112d4af4c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:45.907420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30299112-b28b-429f-a7d8-6112d4af4c60 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:45.931027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 736/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:14:46.847153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044bb3-33ad-4a35-ab8d-006be2546739 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:46.847728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044bb3-33ad-4a35-ab8d-006be2546739 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:46.847728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044bb3-33ad-4a35-ab8d-006be2546739 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:46.849085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 702/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:46.854619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0f6e7-3e0c-4cd0-83ed-4d7985b5da54 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:46.855326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0f6e7-3e0c-4cd0-83ed-4d7985b5da54 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:46.855326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0f6e7-3e0c-4cd0-83ed-4d7985b5da54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:46.948625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7ce0f6e7-3e0c-4cd0-83ed-4d7985b5da54 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:46.949779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7ce0f6e7-3e0c-4cd0-83ed-4d7985b5da54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:46.951972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:47.066113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 737/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:47.221281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044bb3-33ad-4a35-ab8d-006be2546739 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:47.222812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6d044bb3-33ad-4a35-ab8d-006be2546739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:47.392466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044bb3-33ad-4a35-ab8d-006be2546739 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:47.423416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:47.515905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5f42a-df46-4bfd-883a-f8f873ce96de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:47.516426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f42a-df46-4bfd-883a-f8f873ce96de service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:47.516707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f42a-df46-4bfd-883a-f8f873ce96de service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:47.517007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f42a-df46-4bfd-883a-f8f873ce96de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:47.518620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1fb5f42a-df46-4bfd-883a-f8f873ce96de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:47.610993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5f42a-df46-4bfd-883a-f8f873ce96de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:47.612585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5f42a-df46-4bfd-883a-f8f873ce96de service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:47.632041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 703/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:49.454738 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a3019-a9cc-4449-9005-5b9b5a493998 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:49.455288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a3019-a9cc-4449-9005-5b9b5a493998 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:49.455288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a3019-a9cc-4449-9005-5b9b5a493998 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:49.456584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 738/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:49.462449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdd41-3ac5-46b3-9efc-1ae1ed35c045 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:49.462957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdd41-3ac5-46b3-9efc-1ae1ed35c045 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:49.463144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdd41-3ac5-46b3-9efc-1ae1ed35c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:49.505580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:49.531349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a92fdd41-3ac5-46b3-9efc-1ae1ed35c045 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:49.532569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a92fdd41-3ac5-46b3-9efc-1ae1ed35c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:49.632993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 704/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:49.920822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a3019-a9cc-4449-9005-5b9b5a493998 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:49.922374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2c1a3019-a9cc-4449-9005-5b9b5a493998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:50.060605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a3019-a9cc-4449-9005-5b9b5a493998 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:50.116730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:50.172081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6194cd0-6b4b-4c69-97ad-412d9c045b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:50.172606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194cd0-6b4b-4c69-97ad-412d9c045b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:50.172888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194cd0-6b4b-4c69-97ad-412d9c045b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:50.173165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194cd0-6b4b-4c69-97ad-412d9c045b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:50.174843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e6194cd0-6b4b-4c69-97ad-412d9c045b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:50.297546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6194cd0-6b4b-4c69-97ad-412d9c045b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:50.299059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6194cd0-6b4b-4c69-97ad-412d9c045b11 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:50.321259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 739/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:52.397145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50894e30-6c4a-4f9e-b0f0-1729e82ce1cb None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:52.397737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50894e30-6c4a-4f9e-b0f0-1729e82ce1cb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:52.397737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50894e30-6c4a-4f9e-b0f0-1729e82ce1cb None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:52.399067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 705/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:52.404640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b91fd-6a43-40bd-911e-1cfa52c196c8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:52.405088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b91fd-6a43-40bd-911e-1cfa52c196c8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:52.405212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b91fd-6a43-40bd-911e-1cfa52c196c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:52.474060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-083b91fd-6a43-40bd-911e-1cfa52c196c8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:52.475334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-083b91fd-6a43-40bd-911e-1cfa52c196c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:52.488739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:52.573169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 740/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:52.857179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50894e30-6c4a-4f9e-b0f0-1729e82ce1cb None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:52.858751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-50894e30-6c4a-4f9e-b0f0-1729e82ce1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:52.966380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50894e30-6c4a-4f9e-b0f0-1729e82ce1cb None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:52.979559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:53.043082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a594c6-ba92-442c-a745-d8ab55679f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:53.043694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a594c6-ba92-442c-a745-d8ab55679f7e service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:53.043976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a594c6-ba92-442c-a745-d8ab55679f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:53.044253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a594c6-ba92-442c-a745-d8ab55679f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:53.045878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a9a594c6-ba92-442c-a745-d8ab55679f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:53.160114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a594c6-ba92-442c-a745-d8ab55679f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:53.162747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a594c6-ba92-442c-a745-d8ab55679f7e service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:53.182896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 706/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:55.510689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640960f-3d62-4c2c-a20b-f6fe8c36db98 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:55.511221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640960f-3d62-4c2c-a20b-f6fe8c36db98 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:55.511221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640960f-3d62-4c2c-a20b-f6fe8c36db98 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:55.512525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 741/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:55.518468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a70c8-03fb-46db-92d8-bc10eb44e543 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:55.519016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a70c8-03fb-46db-92d8-bc10eb44e543 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:55.519114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a70c8-03fb-46db-92d8-bc10eb44e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:55.571688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:55.590325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9b6a70c8-03fb-46db-92d8-bc10eb44e543 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:55.591600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9b6a70c8-03fb-46db-92d8-bc10eb44e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:55.693398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 707/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:55.987483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640960f-3d62-4c2c-a20b-f6fe8c36db98 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:55.990012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6640960f-3d62-4c2c-a20b-f6fe8c36db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:56.103040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640960f-3d62-4c2c-a20b-f6fe8c36db98 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:56.146036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:56.181025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27967-d1c3-4d05-ac1e-eadcdc571633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:56.181702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27967-d1c3-4d05-ac1e-eadcdc571633 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:56.182248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27967-d1c3-4d05-ac1e-eadcdc571633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:56.182575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27967-d1c3-4d05-ac1e-eadcdc571633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:56.184834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bcc27967-d1c3-4d05-ac1e-eadcdc571633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:56.302358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc27967-d1c3-4d05-ac1e-eadcdc571633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:56.303777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc27967-d1c3-4d05-ac1e-eadcdc571633 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:56.322862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 742/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:58.417327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab491-b828-4ea3-8e88-d80f07e91d68 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:58.418027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab491-b828-4ea3-8e88-d80f07e91d68 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:58.418027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab491-b828-4ea3-8e88-d80f07e91d68 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:58.419326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 708/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:58.425177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db186e7-a2c2-4bc1-b5a8-89cd08879771 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:58.425724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db186e7-a2c2-4bc1-b5a8-89cd08879771 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:58.425724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db186e7-a2c2-4bc1-b5a8-89cd08879771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:58.495334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4db186e7-a2c2-4bc1-b5a8-89cd08879771 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:58.496558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4db186e7-a2c2-4bc1-b5a8-89cd08879771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:58.517947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:58.596374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 743/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:58.882475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab491-b828-4ea3-8e88-d80f07e91d68 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:58.884057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-00cab491-b828-4ea3-8e88-d80f07e91d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:58.990933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab491-b828-4ea3-8e88-d80f07e91d68 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:59.011527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:59.067695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3af83-e3e4-4b30-8829-f9b5ea69c59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:59.068311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3af83-e3e4-4b30-8829-f9b5ea69c59e service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:59.068592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3af83-e3e4-4b30-8829-f9b5ea69c59e service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:59.068865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3af83-e3e4-4b30-8829-f9b5ea69c59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:59.070477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d5e3af83-e3e4-4b30-8829-f9b5ea69c59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:59.183635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3af83-e3e4-4b30-8829-f9b5ea69c59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:59.185088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3af83-e3e4-4b30-8829-f9b5ea69c59e service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:59.205100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 709/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:01.188373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4766-c158-4a36-99af-4b196998c582 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:01.188945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4766-c158-4a36-99af-4b196998c582 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:01.188945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4766-c158-4a36-99af-4b196998c582 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:01.190269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 744/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:15:01.195899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca368f-8139-42eb-8ef9-216528e2cd6f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:01.196355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca368f-8139-42eb-8ef9-216528e2cd6f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:01.196468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca368f-8139-42eb-8ef9-216528e2cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:01.264875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:01.267923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b0ca368f-8139-42eb-8ef9-216528e2cd6f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:01.269142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b0ca368f-8139-42eb-8ef9-216528e2cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:01.379361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 710/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:01.665672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc4766-c158-4a36-99af-4b196998c582 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:01.667265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-abbc4766-c158-4a36-99af-4b196998c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:01.774742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc4766-c158-4a36-99af-4b196998c582 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:01.823668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:01.849209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8096b5-3f36-43cb-8250-eeb0a2d9d633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:01.849823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8096b5-3f36-43cb-8250-eeb0a2d9d633 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:01.850111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8096b5-3f36-43cb-8250-eeb0a2d9d633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:01.850390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8096b5-3f36-43cb-8250-eeb0a2d9d633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:01.852036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ea8096b5-3f36-43cb-8250-eeb0a2d9d633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:01.964975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8096b5-3f36-43cb-8250-eeb0a2d9d633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:01.966334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8096b5-3f36-43cb-8250-eeb0a2d9d633 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:01.985379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 745/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:04.001030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466511e-ffef-471b-b71d-b763be0d7060 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:04.001563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466511e-ffef-471b-b71d-b763be0d7060 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:04.001563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466511e-ffef-471b-b71d-b763be0d7060 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:04.002895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 711/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:04.008791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51dac-79c3-4d3a-baf3-64ddea626401 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:04.009274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51dac-79c3-4d3a-baf3-64ddea626401 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:04.009381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51dac-79c3-4d3a-baf3-64ddea626401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:04.077379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2dc51dac-79c3-4d3a-baf3-64ddea626401 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:04.078604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2dc51dac-79c3-4d3a-baf3-64ddea626401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:04.108328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:04.178038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 746/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:04.462884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466511e-ffef-471b-b71d-b763be0d7060 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:04.464424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d466511e-ffef-471b-b71d-b763be0d7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:04.570819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466511e-ffef-471b-b71d-b763be0d7060 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:04.600269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:04.648466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d0855-e1ee-494b-be99-eb464d32a942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:04.649078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0855-e1ee-494b-be99-eb464d32a942 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:04.649360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0855-e1ee-494b-be99-eb464d32a942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:04.649636 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0855-e1ee-494b-be99-eb464d32a942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:04.651396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-564d0855-e1ee-494b-be99-eb464d32a942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:04.767030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d0855-e1ee-494b-be99-eb464d32a942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:04.768380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d0855-e1ee-494b-be99-eb464d32a942 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:04.787820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 712/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:06.772966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c478cb-dc22-438f-9359-348629937452 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:06.773497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c478cb-dc22-438f-9359-348629937452 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:06.773587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c478cb-dc22-438f-9359-348629937452 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:06.775053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 747/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:06.780718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aef58-2120-4c73-88fd-2aa91a86bdc4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:06.781166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aef58-2120-4c73-88fd-2aa91a86bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:06.781263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aef58-2120-4c73-88fd-2aa91a86bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:06.849688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-522aef58-2120-4c73-88fd-2aa91a86bdc4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:06.850943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-522aef58-2120-4c73-88fd-2aa91a86bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:06.859521 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:06.950311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 713/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:07.248379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c478cb-dc22-438f-9359-348629937452 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:07.250056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16c478cb-dc22-438f-9359-348629937452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:07.355895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c478cb-dc22-438f-9359-348629937452 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:07.413562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:07.432787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa8b5f-f654-4085-85e5-fec73c86fc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:07.433402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa8b5f-f654-4085-85e5-fec73c86fc00 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:07.433685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa8b5f-f654-4085-85e5-fec73c86fc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:07.433961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa8b5f-f654-4085-85e5-fec73c86fc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:07.435606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5bfa8b5f-f654-4085-85e5-fec73c86fc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:07.546606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa8b5f-f654-4085-85e5-fec73c86fc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:07.547998 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa8b5f-f654-4085-85e5-fec73c86fc00 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:07.568083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 748/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:09.566268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44ced-8879-4864-8e72-46df0c375000 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:09.566882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44ced-8879-4864-8e72-46df0c375000 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:09.566882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44ced-8879-4864-8e72-46df0c375000 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:09.568087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 714/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:09.573758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ac65-d7d6-4cf6-b3a8-da109b28fc26 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:09.574246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ac65-d7d6-4cf6-b3a8-da109b28fc26 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:09.574359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ac65-d7d6-4cf6-b3a8-da109b28fc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:09.645736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0a10ac65-d7d6-4cf6-b3a8-da109b28fc26 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:09.646989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0a10ac65-d7d6-4cf6-b3a8-da109b28fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:09.690830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:09.752531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 749/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:10.052142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b44ced-8879-4864-8e72-46df0c375000 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:10.053679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-13b44ced-8879-4864-8e72-46df0c375000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:10.160346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b44ced-8879-4864-8e72-46df0c375000 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:10.199062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:10.236886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0c159-09a9-4299-a345-054c6c17970b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:10.237505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0c159-09a9-4299-a345-054c6c17970b service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:10.237784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0c159-09a9-4299-a345-054c6c17970b service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:10.238100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0c159-09a9-4299-a345-054c6c17970b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:10.240103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-13f0c159-09a9-4299-a345-054c6c17970b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:10.358162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0c159-09a9-4299-a345-054c6c17970b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:10.359684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0c159-09a9-4299-a345-054c6c17970b service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:10.378963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 715/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:12.343299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e358f-d330-4652-9fcc-50e2dfcd7e90 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:12.343914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e358f-d330-4652-9fcc-50e2dfcd7e90 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:12.343914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e358f-d330-4652-9fcc-50e2dfcd7e90 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:12.345227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 750/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:12.351829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073de2-9ad6-4ef3-b68a-150b70758907 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:12.352445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073de2-9ad6-4ef3-b68a-150b70758907 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:12.352576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073de2-9ad6-4ef3-b68a-150b70758907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:12.423621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c2073de2-9ad6-4ef3-b68a-150b70758907 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:12.424850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c2073de2-9ad6-4ef3-b68a-150b70758907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:12.443607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:12.525890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 716/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:12.812296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e358f-d330-4652-9fcc-50e2dfcd7e90 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:12.813864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3e5e358f-d330-4652-9fcc-50e2dfcd7e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:12.918565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e358f-d330-4652-9fcc-50e2dfcd7e90 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:12.988440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:12.995325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e31628-6680-427a-bc1a-2a75f4b89042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:12.996124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31628-6680-427a-bc1a-2a75f4b89042 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:12.996276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31628-6680-427a-bc1a-2a75f4b89042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:12.996557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31628-6680-427a-bc1a-2a75f4b89042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:12.998224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-95e31628-6680-427a-bc1a-2a75f4b89042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:13.111999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e31628-6680-427a-bc1a-2a75f4b89042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:13.114681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e31628-6680-427a-bc1a-2a75f4b89042 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:13.133660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 751/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:15.162342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53838b-1f61-4b36-93ff-337eafd1bf4c None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:15.162951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53838b-1f61-4b36-93ff-337eafd1bf4c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:15.162951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53838b-1f61-4b36-93ff-337eafd1bf4c None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:15.164274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 717/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:15.169861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee19c3e-e7ab-4c56-8248-6d6222612dab None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:15.170335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee19c3e-e7ab-4c56-8248-6d6222612dab None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:15.170460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee19c3e-e7ab-4c56-8248-6d6222612dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:15.238701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3ee19c3e-e7ab-4c56-8248-6d6222612dab None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:15.239945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ee19c3e-e7ab-4c56-8248-6d6222612dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:15.290029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:15.339025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 752/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:15:15.629559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53838b-1f61-4b36-93ff-337eafd1bf4c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:15.631131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fa53838b-1f61-4b36-93ff-337eafd1bf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:15.736491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53838b-1f61-4b36-93ff-337eafd1bf4c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:15.785922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:15.812616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cc711-b7f6-4701-a5ec-81907f6b1f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:15.813229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc711-b7f6-4701-a5ec-81907f6b1f10 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:15.813541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc711-b7f6-4701-a5ec-81907f6b1f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:15.814028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc711-b7f6-4701-a5ec-81907f6b1f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:15.817002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-446cc711-b7f6-4701-a5ec-81907f6b1f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:15.930357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cc711-b7f6-4701-a5ec-81907f6b1f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:15.933886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cc711-b7f6-4701-a5ec-81907f6b1f10 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:15.952956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 718/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:25.337169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=22 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:25.950082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=66 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:35.962855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca58277-66e3-4b0d-a7ba-7adf5a993c92 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:35.963419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca58277-66e3-4b0d-a7ba-7adf5a993c92 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:35.963419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca58277-66e3-4b0d-a7ba-7adf5a993c92 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:35.964773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 753/1471] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:35.970077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83637d-61e3-4147-8c27-3e17d47384e5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:35.976810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83637d-61e3-4147-8c27-3e17d47384e5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:35.976810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83637d-61e3-4147-8c27-3e17d47384e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:36.040733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-af83637d-61e3-4147-8c27-3e17d47384e5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:36.041962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-af83637d-61e3-4147-8c27-3e17d47384e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:36.145898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 719/1472] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:36.446316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb181-453f-4f2a-ad52-601f294f837b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:36.446608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb181-453f-4f2a-ad52-601f294f837b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:36.446915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb181-453f-4f2a-ad52-601f294f837b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:36.448278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 754/1473] 10.222.0.64 () {54 vars in 967 bytes} [Wed Aug 17 20:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:36.453403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5d083-8092-4969-81ac-a02e1a2ddfb5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:36.453695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5d083-8092-4969-81ac-a02e1a2ddfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:36.454007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5d083-8092-4969-81ac-a02e1a2ddfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:36.535157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-30a5d083-8092-4969-81ac-a02e1a2ddfb5 None None] MFA Rules not processed for user `6e3e10f9efeb4b908bf3d74ce1eb6a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:36.536383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-30a5d083-8092-4969-81ac-a02e1a2ddfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:36.558055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:36.616443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 720/1474] 10.222.0.64 () {58 vars in 1064 bytes} [Wed Aug 17 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:36.624269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfb181-453f-4f2a-ad52-601f294f837b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:36.625816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a7cfb181-453f-4f2a-ad52-601f294f837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:36.731970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfb181-453f-4f2a-ad52-601f294f837b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:36.808141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6bfc1-4050-4078-9ded-ce7b1c985e6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e3e10f9efeb4b908bf3d74ce1eb6a3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:36.808761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6bfc1-4050-4078-9ded-ce7b1c985e6d service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:36.809043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6bfc1-4050-4078-9ded-ce7b1c985e6d service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:36.809319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6bfc1-4050-4078-9ded-ce7b1c985e6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:36.810996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-65a6bfc1-4050-4078-9ded-ce7b1c985e6d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:36.868040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:36.926589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6bfc1-4050-4078-9ded-ce7b1c985e6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:36.928073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6bfc1-4050-4078-9ded-ce7b1c985e6d service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:36.948504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 755/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:39.003282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542812e9-039f-40f3-a6f8-6246c118f05f None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:39.003820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542812e9-039f-40f3-a6f8-6246c118f05f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:39.003820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542812e9-039f-40f3-a6f8-6246c118f05f None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:39.005088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 721/1476] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:39.010650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa691cd-c32a-44b6-848a-50b33d498e83 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:39.011099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa691cd-c32a-44b6-848a-50b33d498e83 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:39.011210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa691cd-c32a-44b6-848a-50b33d498e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:39.077025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0fa691cd-c32a-44b6-848a-50b33d498e83 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:39.078238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0fa691cd-c32a-44b6-848a-50b33d498e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:39.176555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 756/1477] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:39.451105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542812e9-039f-40f3-a6f8-6246c118f05f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:39.452682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-542812e9-039f-40f3-a6f8-6246c118f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:39.579945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542812e9-039f-40f3-a6f8-6246c118f05f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:39.630851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:39.678443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30ae86-3dc3-4646-99df-f93a3dc5e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:39.678937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30ae86-3dc3-4646-99df-f93a3dc5e415 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:39.679216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30ae86-3dc3-4646-99df-f93a3dc5e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:39.679487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30ae86-3dc3-4646-99df-f93a3dc5e415 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:39.680129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30ae86-3dc3-4646-99df-f93a3dc5e415 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:39.681858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-ac30ae86-3dc3-4646-99df-f93a3dc5e415 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:15:39.681858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:15:39.681858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:15:39.683054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30ae86-3dc3-4646-99df-f93a3dc5e415 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:39.703910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 722/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 17 20:15:39 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:15:41.674445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee6965-ce82-48cd-abfe-f99f54e118ed None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:41.675324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee6965-ce82-48cd-abfe-f99f54e118ed None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:41.675324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee6965-ce82-48cd-abfe-f99f54e118ed None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:41.676474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 757/1479] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:41.681953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92714b-095d-4484-8158-6ca9ee87b1a5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:41.682395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92714b-095d-4484-8158-6ca9ee87b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:41.682493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92714b-095d-4484-8158-6ca9ee87b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:41.748247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-8d92714b-095d-4484-8158-6ca9ee87b1a5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:41.749460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8d92714b-095d-4484-8158-6ca9ee87b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:41.848863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 723/1480] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:42.147710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee6965-ce82-48cd-abfe-f99f54e118ed None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:42.149217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-79ee6965-ce82-48cd-abfe-f99f54e118ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:42.160036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:42.307942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee6965-ce82-48cd-abfe-f99f54e118ed None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:42.390457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:42.424799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617aa9-84d1-4f5c-a262-7489dfb237b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:42.429252 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617aa9-84d1-4f5c-a262-7489dfb237b8 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:42.429252 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617aa9-84d1-4f5c-a262-7489dfb237b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:42.429252 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617aa9-84d1-4f5c-a262-7489dfb237b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:42.429252 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8617aa9-84d1-4f5c-a262-7489dfb237b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:42.521788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617aa9-84d1-4f5c-a262-7489dfb237b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:42.523433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617aa9-84d1-4f5c-a262-7489dfb237b8 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:42.542681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 758/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:44.687469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae013236-07fa-4471-a336-0e8dc9b57879 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:44.687981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae013236-07fa-4471-a336-0e8dc9b57879 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:44.688084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae013236-07fa-4471-a336-0e8dc9b57879 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:44.689380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 724/1482] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:44.695173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2749a-cbd1-4e8f-98cf-33183968bc6a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:44.695607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2749a-cbd1-4e8f-98cf-33183968bc6a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:44.695727 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2749a-cbd1-4e8f-98cf-33183968bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:44.761101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-56b2749a-cbd1-4e8f-98cf-33183968bc6a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:44.762587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56b2749a-cbd1-4e8f-98cf-33183968bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:44.809173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:44.860530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 759/1483] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:45.151750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae013236-07fa-4471-a336-0e8dc9b57879 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:45.153287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ae013236-07fa-4471-a336-0e8dc9b57879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:45.180353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:45.265863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae013236-07fa-4471-a336-0e8dc9b57879 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:45.340496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d0fe-ad42-4ec5-b534-c2382eac3b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:45.341103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d0fe-ad42-4ec5-b534-c2382eac3b71 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:45.341383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d0fe-ad42-4ec5-b534-c2382eac3b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:45.341656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d0fe-ad42-4ec5-b534-c2382eac3b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:45.343269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2315d0fe-ad42-4ec5-b534-c2382eac3b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:45.420879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:45.457972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d0fe-ad42-4ec5-b534-c2382eac3b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:45.459495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d0fe-ad42-4ec5-b534-c2382eac3b71 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:45.477935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 725/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:47.493835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db543-399c-42df-b1ef-538694b6fd90 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:47.494381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db543-399c-42df-b1ef-538694b6fd90 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:47.494381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db543-399c-42df-b1ef-538694b6fd90 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:47.495787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 760/1485] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:47.502208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c29c-6f18-40a1-b445-be8b5ebecc8c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:47.502985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c29c-6f18-40a1-b445-be8b5ebecc8c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:47.503195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c29c-6f18-40a1-b445-be8b5ebecc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:47.586475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e804c29c-6f18-40a1-b445-be8b5ebecc8c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:47.587775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e804c29c-6f18-40a1-b445-be8b5ebecc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:47.696254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 726/1486] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:47.999384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3db543-399c-42df-b1ef-538694b6fd90 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:48.002775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9f3db543-399c-42df-b1ef-538694b6fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:48.117637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3db543-399c-42df-b1ef-538694b6fd90 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:48.194717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:48.196536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4587e6-ee30-4f16-b904-16621b645911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:48.197151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4587e6-ee30-4f16-b904-16621b645911 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:48.197432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4587e6-ee30-4f16-b904-16621b645911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:48.197707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4587e6-ee30-4f16-b904-16621b645911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:48.199358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8d4587e6-ee30-4f16-b904-16621b645911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:48.309956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4587e6-ee30-4f16-b904-16621b645911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:48.311488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4587e6-ee30-4f16-b904-16621b645911 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:48.331346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 761/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:50.379810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11f48-1df1-48a1-bb4c-3772149652aa None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:50.380386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11f48-1df1-48a1-bb4c-3772149652aa None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:50.380386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11f48-1df1-48a1-bb4c-3772149652aa None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:50.381822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 727/1488] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:50.387542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f45a4-458f-4ed7-8a90-906cb37f9983 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:50.387971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f45a4-458f-4ed7-8a90-906cb37f9983 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:50.388107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f45a4-458f-4ed7-8a90-906cb37f9983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:50.456983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d43f45a4-458f-4ed7-8a90-906cb37f9983 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:50.458211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d43f45a4-458f-4ed7-8a90-906cb37f9983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:50.512351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:50.557482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 762/1489] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:50.856407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11f48-1df1-48a1-bb4c-3772149652aa None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:50.857942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-17a11f48-1df1-48a1-bb4c-3772149652aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:50.895541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:50.965361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11f48-1df1-48a1-bb4c-3772149652aa None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:51.042090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bcff9-952f-4b3e-85a2-ab1a61d463a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:51.042727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bcff9-952f-4b3e-85a2-ab1a61d463a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:51.043014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bcff9-952f-4b3e-85a2-ab1a61d463a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:51.043296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bcff9-952f-4b3e-85a2-ab1a61d463a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:51.044937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-888bcff9-952f-4b3e-85a2-ab1a61d463a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:51.126512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:51.156329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bcff9-952f-4b3e-85a2-ab1a61d463a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:51.157770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bcff9-952f-4b3e-85a2-ab1a61d463a9 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:51.177718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 728/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:53.607140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a20d-69c2-4da6-98d9-c5f69d9de547 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:53.607674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a20d-69c2-4da6-98d9-c5f69d9de547 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:53.607772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a20d-69c2-4da6-98d9-c5f69d9de547 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:53.609172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 763/1491] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 17 20:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:53.615803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5194180-2612-4ad8-a251-a46a9696b1c1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:53.616312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5194180-2612-4ad8-a251-a46a9696b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:53.616413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5194180-2612-4ad8-a251-a46a9696b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:53.686095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d5194180-2612-4ad8-a251-a46a9696b1c1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:53.687368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d5194180-2612-4ad8-a251-a46a9696b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:53.786922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 729/1492] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:15:54.083209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a20d-69c2-4da6-98d9-c5f69d9de547 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:54.084806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3084a20d-69c2-4da6-98d9-c5f69d9de547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:54.189091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a20d-69c2-4da6-98d9-c5f69d9de547 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:54.266643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859f5a7-5dc7-4ddf-b438-007cc1018d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:54.267288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859f5a7-5dc7-4ddf-b438-007cc1018d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:54.268143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859f5a7-5dc7-4ddf-b438-007cc1018d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:54.268448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859f5a7-5dc7-4ddf-b438-007cc1018d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:54.270139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4859f5a7-5dc7-4ddf-b438-007cc1018d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:54.280091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:54.387436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859f5a7-5dc7-4ddf-b438-007cc1018d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:54.388878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859f5a7-5dc7-4ddf-b438-007cc1018d01 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:54.408429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 764/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:16:03.785041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=82 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:04.405817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=50 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:38.571129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff34a19-7278-407d-a91d-fe7661db1bc2 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:38.571789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff34a19-7278-407d-a91d-fe7661db1bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:38.571789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff34a19-7278-407d-a91d-fe7661db1bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:38.656848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1ff34a19-7278-407d-a91d-fe7661db1bc2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:38.658076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1ff34a19-7278-407d-a91d-fe7661db1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:38.765063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 730/1494] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:38.773765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75658a5-f9bf-4c4a-9a89-63a8e6b0b2ca None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:38.774267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75658a5-f9bf-4c4a-9a89-63a8e6b0b2ca None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:38.774358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75658a5-f9bf-4c4a-9a89-63a8e6b0b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:38.794281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e75658a5-f9bf-4c4a-9a89-63a8e6b0b2ca None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:38.795537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e75658a5-f9bf-4c4a-9a89-63a8e6b0b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:38.805030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 765/1495] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:38.810031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff34a19-7278-407d-a91d-fe7661db1bc2 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:38.820813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff34a19-7278-407d-a91d-fe7661db1bc2 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:38.825875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:38.826423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:38.826741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:38.827065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:38.827726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:17:38.828034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:38.829179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:38.829179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:17:38.829179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:17:38.830075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:38.842177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 731/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:17:38.851452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75658a5-f9bf-4c4a-9a89-63a8e6b0b2ca None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:38.862114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75658a5-f9bf-4c4a-9a89-63a8e6b0b2ca None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:38.866829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:38.867474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:38.867757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:38.868034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:38.868674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:38.870464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING py.warnings [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:38.870464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 20:17:38.870464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: Aug 17 20:17:38.871719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.051997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 766/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:17:38 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:17:39.056284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.067476 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce5555-e983-4350-8fb2-be57acaaa4e1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.119369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:39.127178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.128507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.128507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.128507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.128982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.130028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.130028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:17:39.130028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:17:39.131290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.239421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 732/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:17:39 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:17:39.243711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.255210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b0f5e-d9cd-4504-96c0-0b44b519ef92 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.260330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.261008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.261330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.261609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.262382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.263534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING py.warnings [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.263534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 20:17:39.263534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: Aug 17 20:17:39.264441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.278518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 767/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:17:39.283340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.293775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7e13b-5c5e-43d4-8305-5060d7ad6b38 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.299333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe388442-f0b6-491e-9eb0-ecaf28eb0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.299943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388442-f0b6-491e-9eb0-ecaf28eb0aec admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.300231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388442-f0b6-491e-9eb0-ecaf28eb0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.300510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388442-f0b6-491e-9eb0-ecaf28eb0aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.301179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe388442-f0b6-491e-9eb0-ecaf28eb0aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.302238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-fe388442-f0b6-491e-9eb0-ecaf28eb0aec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.302238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:17:39.302238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:17:39.303169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe388442-f0b6-491e-9eb0-ecaf28eb0aec admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.318725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 733/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:17:39.323250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.333854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeefb6-15e9-40b8-bf40-9a8b9d3ac565 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.343031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525499-1f52-4a6a-8c20-4437c6dc0e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.343713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525499-1f52-4a6a-8c20-4437c6dc0e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.344006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525499-1f52-4a6a-8c20-4437c6dc0e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.345083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525499-1f52-4a6a-8c20-4437c6dc0e68 admin admin] PATH_INFO: `/v3/projects/c673cd91a1a94308bfb5c3ce93badc0e/users/1407add946464860b5e7724d4e166fd9/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.361747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525499-1f52-4a6a-8c20-4437c6dc0e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c673cd91a1a94308bfb5c3ce93badc0e, user_id=1407add946464860b5e7724d4e166fd9, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.362831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING py.warnings [None req-89525499-1f52-4a6a-8c20-4437c6dc0e68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.362831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 20:17:39.362831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: Aug 17 20:17:39.364837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525499-1f52-4a6a-8c20-4437c6dc0e68 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.446579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 768/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:17:39 2022] PUT /identity/v3/projects/c673cd91a1a94308bfb5c3ce93badc0e/users/1407add946464860b5e7724d4e166fd9/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:17:39.459352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b3fc-3ed2-415a-87db-413c986d5e4a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.459782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b3fc-3ed2-415a-87db-413c986d5e4a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.460167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b3fc-3ed2-415a-87db-413c986d5e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.493766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0301b3fc-3ed2-415a-87db-413c986d5e4a None None] MFA Rules not processed for user `1407add946464860b5e7724d4e166fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:39.495032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0301b3fc-3ed2-415a-87db-413c986d5e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:39.559674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 734/1502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:17:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:39.572985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a58b8-bcdd-4b12-9865-a94cd6f94e22 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.573264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a58b8-bcdd-4b12-9865-a94cd6f94e22 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.573512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a58b8-bcdd-4b12-9865-a94cd6f94e22 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.574914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 769/1503] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 17 20:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:17:39.580672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fe3aa-40b1-47b8-b680-4f4fd06b386f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.581160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fe3aa-40b1-47b8-b680-4f4fd06b386f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.581253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fe3aa-40b1-47b8-b680-4f4fd06b386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.644549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6c6fe3aa-40b1-47b8-b680-4f4fd06b386f None None] MFA Rules not processed for user `0ac7372634fa47df8d7fb36c98f7e0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:39.645787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6c6fe3aa-40b1-47b8-b680-4f4fd06b386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:39.727950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 735/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 17 20:17:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:17:39.735934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a58b8-bcdd-4b12-9865-a94cd6f94e22 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.747988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a58b8-bcdd-4b12-9865-a94cd6f94e22 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.751565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.752198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.752478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.752749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.761702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.763178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.773181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 770/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:17:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:17:39.820530 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d73b-f5ec-491a-81a5-f567a69fdf7a None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.820827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d73b-f5ec-491a-81a5-f567a69fdf7a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.821110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d73b-f5ec-491a-81a5-f567a69fdf7a None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.822398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 736/1506] 10.222.0.64 () {52 vars in 830 bytes} [Wed Aug 17 20:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:17:39.825913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.890775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968be2-5d28-4606-8981-566820f408d1 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.895854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.896542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.896876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.897160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] PATH_INFO: `/v3/users/1407add946464860b5e7724d4e166fd9` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.898303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1407add946464860b5e7724d4e166fd9)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.899353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING py.warnings [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.899353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 20:17:39.899353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: Aug 17 20:17:39.900650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:40.137674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1407add946464860b5e7724d4e166fd9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:40.165039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1407add946464860b5e7724d4e166fd9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:40.180971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1407add946464860b5e7724d4e166fd9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:40.181868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1407add946464860b5e7724d4e166fd9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:40.186064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:40.284548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1407add946464860b5e7724d4e166fd9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:40.291642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 771/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:17:39 2022] DELETE /identity/v3/users/1407add946464860b5e7724d4e166fd9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:17:40.296269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.296549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.296853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.317154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:40.318387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:40.328930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:40.383405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 737/1508] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:40.397286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:40.398780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:40.482724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b3c5-4b79-4bf8-8bd0-8488e42cff1c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:40.486496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a7b98-6ad2-4ee3-87d7-0b2251ea6f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:40.487267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a7b98-6ad2-4ee3-87d7-0b2251ea6f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.487436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a7b98-6ad2-4ee3-87d7-0b2251ea6f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.487710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a7b98-6ad2-4ee3-87d7-0b2251ea6f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.498509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a7b98-6ad2-4ee3-87d7-0b2251ea6f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:40.500287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a7b98-6ad2-4ee3-87d7-0b2251ea6f27 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:40.511883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 772/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:17:41.162772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:41.164322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:41.177690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458e6d-dd23-4459-82b5-3f4ca15703d7 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:41.182382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:41.183060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:41.183332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:41.183602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] PATH_INFO: `/v3/projects/c673cd91a1a94308bfb5c3ce93badc0e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:41.184756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c673cd91a1a94308bfb5c3ce93badc0e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:41.185772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:41.185772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:17:41.185772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:17:41.187013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:41.333200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c673cd91a1a94308bfb5c3ce93badc0e', 'request_id': 'req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.339516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c673cd91a1a94308bfb5c3ce93badc0e', 'request_id': 'req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.406080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c673cd91a1a94308bfb5c3ce93badc0e', 'request_id': 'req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.426532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] The token cache is being invalidate because project c673cd91a1a94308bfb5c3ce93badc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:17:41.426857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.427630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7f1dd7a-4bdf-49d8-a28b-b32d93ef1f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.429170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 738/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:17:41 2022] DELETE /identity/v3/projects/c673cd91a1a94308bfb5c3ce93badc0e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:17:50.506186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:51.423604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:14.367431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea3dc-ab10-410f-8a98-0cc0c890b522 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:14.368050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea3dc-ab10-410f-8a98-0cc0c890b522 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:14.368050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea3dc-ab10-410f-8a98-0cc0c890b522 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:14.369359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 773/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:14.374577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b82a-47b6-4c6f-b36f-2c3f2f92c1ec None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:14.375025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b82a-47b6-4c6f-b36f-2c3f2f92c1ec None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:14.375183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b82a-47b6-4c6f-b36f-2c3f2f92c1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:14.396276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c8f8b82a-47b6-4c6f-b36f-2c3f2f92c1ec None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:14.397498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c8f8b82a-47b6-4c6f-b36f-2c3f2f92c1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:14.456815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 739/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:14.613343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea3dc-ab10-410f-8a98-0cc0c890b522 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:14.615259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e2eea3dc-ab10-410f-8a98-0cc0c890b522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:14.720820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea3dc-ab10-410f-8a98-0cc0c890b522 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:14.727016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa2790-89bb-4747-a401-f24b89fe7e86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:14.727627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa2790-89bb-4747-a401-f24b89fe7e86 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:14.727914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa2790-89bb-4747-a401-f24b89fe7e86 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:14.728189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa2790-89bb-4747-a401-f24b89fe7e86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:14.736421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa2790-89bb-4747-a401-f24b89fe7e86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:14.738065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa2790-89bb-4747-a401-f24b89fe7e86 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:14.748395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 774/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:15.590315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd066f-b614-498c-a6d9-a6c949fbbcde None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:15.590928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd066f-b614-498c-a6d9-a6c949fbbcde None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:15.591068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd066f-b614-498c-a6d9-a6c949fbbcde None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:15.592336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 740/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:15.597068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e5c2-fe11-4a8e-a7fd-b9539dea0108 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:15.597516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e5c2-fe11-4a8e-a7fd-b9539dea0108 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:15.597625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e5c2-fe11-4a8e-a7fd-b9539dea0108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:15.738790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8505e5c2-fe11-4a8e-a7fd-b9539dea0108 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:15.740082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8505e5c2-fe11-4a8e-a7fd-b9539dea0108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:15.747919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 775/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:15.901492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd066f-b614-498c-a6d9-a6c949fbbcde None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:15.916538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd066f-b614-498c-a6d9-a6c949fbbcde None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:15.921909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b1a0-8c81-4013-b0f1-bc89b802e858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:15.922505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b1a0-8c81-4013-b0f1-bc89b802e858 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:15.922829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b1a0-8c81-4013-b0f1-bc89b802e858 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:15.923107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b1a0-8c81-4013-b0f1-bc89b802e858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:15.931731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b1a0-8c81-4013-b0f1-bc89b802e858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:15.933301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b1a0-8c81-4013-b0f1-bc89b802e858 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:15.942733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 741/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:16.583403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fd333-44f2-4f48-9c81-3725a9b9e785 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:16.583615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fd333-44f2-4f48-9c81-3725a9b9e785 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:16.583878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fd333-44f2-4f48-9c81-3725a9b9e785 None None] PATH_INFO: `/v3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:16.585180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 776/1517] 10.222.0.69 () {54 vars in 925 bytes} [Wed Aug 17 20:19:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:19:16.592895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb33bc-890f-4366-ac06-8860edb5c337 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:16.593406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb33bc-890f-4366-ac06-8860edb5c337 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:16.593512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb33bc-890f-4366-ac06-8860edb5c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:16.643060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2abb33bc-890f-4366-ac06-8860edb5c337 None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:16.644252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2abb33bc-890f-4366-ac06-8860edb5c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:16.719562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 742/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Aug 17 20:19:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:19:25.733454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=49 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:26.716616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=77 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:27.199877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fff3e-f58f-4de9-94a1-eaccb08e797e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:27.200444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fff3e-f58f-4de9-94a1-eaccb08e797e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:27.200444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fff3e-f58f-4de9-94a1-eaccb08e797e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:27.201779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 777/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:27.206582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00665e1-734a-44dc-ae94-9ca68dc786a5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:27.206929 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00665e1-734a-44dc-ae94-9ca68dc786a5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:27.207209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00665e1-734a-44dc-ae94-9ca68dc786a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:27.227198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f00665e1-734a-44dc-ae94-9ca68dc786a5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:27.228433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f00665e1-734a-44dc-ae94-9ca68dc786a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:27.236266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 743/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:27.393254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fff3e-f58f-4de9-94a1-eaccb08e797e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:27.408082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fff3e-f58f-4de9-94a1-eaccb08e797e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:27.413469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78b6d7-9f93-4d89-b291-44ab73470598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:27.414043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b6d7-9f93-4d89-b291-44ab73470598 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:27.414329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b6d7-9f93-4d89-b291-44ab73470598 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:27.414605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b6d7-9f93-4d89-b291-44ab73470598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:27.423378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78b6d7-9f93-4d89-b291-44ab73470598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:27.424976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78b6d7-9f93-4d89-b291-44ab73470598 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:27.434733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 778/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:27.991925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25bd76-9a0f-47f2-8389-139c0c2f2584 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:27.992451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25bd76-9a0f-47f2-8389-139c0c2f2584 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:27.992451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25bd76-9a0f-47f2-8389-139c0c2f2584 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:27.994729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 744/1522] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 17 20:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:28.000181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e852a-e328-42fc-8de1-7149787b98bd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:28.000470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e852a-e328-42fc-8de1-7149787b98bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:28.000749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e852a-e328-42fc-8de1-7149787b98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:28.021679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b43e852a-e328-42fc-8de1-7149787b98bd None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:28.027715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b43e852a-e328-42fc-8de1-7149787b98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:28.031673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 779/1523] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 17 20:19:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:28.039626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25bd76-9a0f-47f2-8389-139c0c2f2584 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:28.054454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25bd76-9a0f-47f2-8389-139c0c2f2584 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:28.060254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c92382-f032-4cb3-958b-1125ab65cf60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:28.060868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92382-f032-4cb3-958b-1125ab65cf60 service placement] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:28.061151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92382-f032-4cb3-958b-1125ab65cf60 service placement] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:28.061430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92382-f032-4cb3-958b-1125ab65cf60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:28.070331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c92382-f032-4cb3-958b-1125ab65cf60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:28.072787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c92382-f032-4cb3-958b-1125ab65cf60 service placement] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:28.083170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 745/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:19:28.273638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ea715-2783-4039-a2a2-209a7bc8674b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:28.273638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ea715-2783-4039-a2a2-209a7bc8674b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:28.273638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ea715-2783-4039-a2a2-209a7bc8674b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:28.274542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 780/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:28.280548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269604a6-8bca-4803-8c0a-d7ee984dbfe8 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:28.280841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269604a6-8bca-4803-8c0a-d7ee984dbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:28.281129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269604a6-8bca-4803-8c0a-d7ee984dbfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:28.301063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-269604a6-8bca-4803-8c0a-d7ee984dbfe8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:28.302269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-269604a6-8bca-4803-8c0a-d7ee984dbfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:28.310931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 746/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:28.467786 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ea715-2783-4039-a2a2-209a7bc8674b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:28.482958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ea715-2783-4039-a2a2-209a7bc8674b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:28.488488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc93d3-dbe8-4a4b-9f99-c004516b7a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:28.489086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc93d3-dbe8-4a4b-9f99-c004516b7a23 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:28.489370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc93d3-dbe8-4a4b-9f99-c004516b7a23 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:28.489648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc93d3-dbe8-4a4b-9f99-c004516b7a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:28.498762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc93d3-dbe8-4a4b-9f99-c004516b7a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:28.500365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc93d3-dbe8-4a4b-9f99-c004516b7a23 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:28.510203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 781/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:32.392940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c59b5d-5fc4-4592-aff2-4de28e79879e None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:32.393562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c59b5d-5fc4-4592-aff2-4de28e79879e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:32.393562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c59b5d-5fc4-4592-aff2-4de28e79879e None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:32.394909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:32.399947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c59ad-c4b8-4884-847a-5489b207e0ca None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:32.400386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c59ad-c4b8-4884-847a-5489b207e0ca None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:32.400511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c59ad-c4b8-4884-847a-5489b207e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:32.420115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dd6c59ad-c4b8-4884-847a-5489b207e0ca None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:32.421316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dd6c59ad-c4b8-4884-847a-5489b207e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:32.429031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:32.723787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c59b5d-5fc4-4592-aff2-4de28e79879e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:32.725507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d9c59b5d-5fc4-4592-aff2-4de28e79879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:32.784837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c59b5d-5fc4-4592-aff2-4de28e79879e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:32.788883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5c6e-20b2-458b-81b3-57d1157c459e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:32.789493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5c6e-20b2-458b-81b3-57d1157c459e service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:32.789776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5c6e-20b2-458b-81b3-57d1157c459e service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:32.790053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5c6e-20b2-458b-81b3-57d1157c459e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:32.800151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5c6e-20b2-458b-81b3-57d1157c459e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:32.801868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5c6e-20b2-458b-81b3-57d1157c459e service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:32.811974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 748/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:34.758846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9724-a067-47b7-b721-ee88ab3dcae8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:34.759452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9724-a067-47b7-b721-ee88ab3dcae8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:34.759452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9724-a067-47b7-b721-ee88ab3dcae8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:34.760847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 783/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:34.766209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20584a2-9393-43a7-b46f-4c503764f0bb None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:34.766675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20584a2-9393-43a7-b46f-4c503764f0bb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:34.766789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20584a2-9393-43a7-b46f-4c503764f0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:34.787221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b20584a2-9393-43a7-b46f-4c503764f0bb None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:34.788406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b20584a2-9393-43a7-b46f-4c503764f0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:34.796930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 749/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:35.085143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9724-a067-47b7-b721-ee88ab3dcae8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:35.096795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9724-a067-47b7-b721-ee88ab3dcae8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:35.100747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217e11-ea91-4ba3-a722-47a95a989cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:35.101339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217e11-ea91-4ba3-a722-47a95a989cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:35.101615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217e11-ea91-4ba3-a722-47a95a989cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:35.101884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217e11-ea91-4ba3-a722-47a95a989cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:35.111166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41217e11-ea91-4ba3-a722-47a95a989cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:35.112583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41217e11-ea91-4ba3-a722-47a95a989cf5 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:35.123384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 784/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:38.646048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca875b-f5ea-4382-a6fc-445e68eda70d None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:38.646585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca875b-f5ea-4382-a6fc-445e68eda70d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:38.646585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca875b-f5ea-4382-a6fc-445e68eda70d None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:38.648017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 750/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:38.654199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2616917-05ab-409f-9916-19a3b00847e0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:38.654644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2616917-05ab-409f-9916-19a3b00847e0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:38.654779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2616917-05ab-409f-9916-19a3b00847e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:38.674916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d2616917-05ab-409f-9916-19a3b00847e0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:38.676174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2616917-05ab-409f-9916-19a3b00847e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:38.684281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 785/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:39.252284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca875b-f5ea-4382-a6fc-445e68eda70d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:39.254109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-19ca875b-f5ea-4382-a6fc-445e68eda70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:39.315837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca875b-f5ea-4382-a6fc-445e68eda70d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:39.319411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1fb8f-9ccf-460c-a39e-92631a0b6c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:39.320055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1fb8f-9ccf-460c-a39e-92631a0b6c86 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:39.320341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1fb8f-9ccf-460c-a39e-92631a0b6c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:39.320624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1fb8f-9ccf-460c-a39e-92631a0b6c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:39.330663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1fb8f-9ccf-460c-a39e-92631a0b6c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:39.332129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1fb8f-9ccf-460c-a39e-92631a0b6c86 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:39.341854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 751/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:41.328824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491fd76-8750-4ebd-b849-3d7775c297ea None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:41.329358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491fd76-8750-4ebd-b849-3d7775c297ea None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:41.329358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491fd76-8750-4ebd-b849-3d7775c297ea None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:41.330752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 786/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:41.336173 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8cca-7894-4cb5-8304-f815f738f2ef None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:41.336621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8cca-7894-4cb5-8304-f815f738f2ef None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:41.336757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8cca-7894-4cb5-8304-f815f738f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:41.357419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2aed8cca-7894-4cb5-8304-f815f738f2ef None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:41.358652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2aed8cca-7894-4cb5-8304-f815f738f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:41.366553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 752/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:41.933388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491fd76-8750-4ebd-b849-3d7775c297ea None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:41.935033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6491fd76-8750-4ebd-b849-3d7775c297ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:41.949893 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491fd76-8750-4ebd-b849-3d7775c297ea None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:41.953734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1da795-71d8-433f-b336-b6cb3706c0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:41.954343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da795-71d8-433f-b336-b6cb3706c0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:41.954650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da795-71d8-433f-b336-b6cb3706c0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:41.954969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da795-71d8-433f-b336-b6cb3706c0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:41.965293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1da795-71d8-433f-b336-b6cb3706c0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:41.966752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1da795-71d8-433f-b336-b6cb3706c0d3 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:41.976389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 787/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:51.352420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=70 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:51.972161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=33 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:06.620725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9c30b-a801-4427-b0a7-23af9673b903 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.621400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9c30b-a801-4427-b0a7-23af9673b903 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.621673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9c30b-a801-4427-b0a7-23af9673b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.632992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0753-bdff-4af3-8559-5a0055a86ca0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.633621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0753-bdff-4af3-8559-5a0055a86ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.633621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0753-bdff-4af3-8559-5a0055a86ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.664879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ede9c30b-a801-4427-b0a7-23af9673b903 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:06.666952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ede9c30b-a801-4427-b0a7-23af9673b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:06.668406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-662a0753-bdff-4af3-8559-5a0055a86ca0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:06.673236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-662a0753-bdff-4af3-8559-5a0055a86ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:06.694406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 788/1540] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:06.700178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd330c-78aa-4eb3-8a65-bae59693c83a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.700475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd330c-78aa-4eb3-8a65-bae59693c83a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.700754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd330c-78aa-4eb3-8a65-bae59693c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.709738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 753/1541] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:06.723446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0cb0-85a5-44e3-ae39-60fc36c86aa7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.723949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0cb0-85a5-44e3-ae39-60fc36c86aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.724413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0cb0-85a5-44e3-ae39-60fc36c86aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.744105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d1bd330c-78aa-4eb3-8a65-bae59693c83a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:06.745559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d1bd330c-78aa-4eb3-8a65-bae59693c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:06.762439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 789/1542] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:06.771722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd330c-78aa-4eb3-8a65-bae59693c83a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:06.785087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b50d0cb0-85a5-44e3-ae39-60fc36c86aa7 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:06.791654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b50d0cb0-85a5-44e3-ae39-60fc36c86aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:06.797178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd330c-78aa-4eb3-8a65-bae59693c83a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:06.802266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:06.807038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.807331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.807614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.808299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:06.808606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:06.809632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING py.warnings [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:06.809632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 20:21:06.809632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: Aug 17 20:21:06.811447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:06.811765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 754/1543] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:06.817922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cecd5-f3f3-42a5-a58e-8d119291d701 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.818400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cecd5-f3f3-42a5-a58e-8d119291d701 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.818902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cecd5-f3f3-42a5-a58e-8d119291d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.844828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 790/1544] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:06.847022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:06.870410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bf4cecd5-f3f3-42a5-a58e-8d119291d701 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:06.874583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277e389-7b12-4797-a0d3-886d72bad686 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:06.877807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bf4cecd5-f3f3-42a5-a58e-8d119291d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:06.885881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:06.886934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.888033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.888571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.890199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:06.891358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:06.895041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:06.900440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 755/1545] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:06.907631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743959-c23e-41b0-9639-bfb7127f9fea None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.908237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743959-c23e-41b0-9639-bfb7127f9fea None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.908818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743959-c23e-41b0-9639-bfb7127f9fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.924127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 791/1546] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:06.928281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:06.946002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-18743959-c23e-41b0-9639-bfb7127f9fea None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:06.947597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-18743959-c23e-41b0-9639-bfb7127f9fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:06.948528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c6f0-fec3-4bc7-aac4-cb75d2f7766b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:06.964718 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db233a-2d41-4104-ab1c-7b780a804fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:06.965850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db233a-2d41-4104-ab1c-7b780a804fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.966351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db233a-2d41-4104-ab1c-7b780a804fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.967515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db233a-2d41-4104-ab1c-7b780a804fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:06.968652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db233a-2d41-4104-ab1c-7b780a804fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:06.973931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 756/1547] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:06.978082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db233a-2d41-4104-ab1c-7b780a804fc8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:06.980947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236f147-64ff-4313-90d2-563263b94466 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:06.981512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236f147-64ff-4313-90d2-563263b94466 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:06.982011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236f147-64ff-4313-90d2-563263b94466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.021107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e236f147-64ff-4313-90d2-563263b94466 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.023272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e236f147-64ff-4313-90d2-563263b94466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.046026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 757/1548] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.050391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236f147-64ff-4313-90d2-563263b94466 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.062578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236f147-64ff-4313-90d2-563263b94466 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.068196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14c417-891e-4e92-be98-b27528bd7afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.068818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c417-891e-4e92-be98-b27528bd7afa admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.069104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c417-891e-4e92-be98-b27528bd7afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.069384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c417-891e-4e92-be98-b27528bd7afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.070027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14c417-891e-4e92-be98-b27528bd7afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.071081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-6b14c417-891e-4e92-be98-b27528bd7afa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:07.071081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:21:07.071081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:21:07.072300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14c417-891e-4e92-be98-b27528bd7afa admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.157134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 792/1549] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:06 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:07.158304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f322d-01fd-4c43-9463-5264f225ddc5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.158594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f322d-01fd-4c43-9463-5264f225ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.158910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f322d-01fd-4c43-9463-5264f225ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.178727 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-428f322d-01fd-4c43-9463-5264f225ddc5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.179935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-428f322d-01fd-4c43-9463-5264f225ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.197321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 758/1550] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:07.201406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d22175-2e5b-462c-9a9b-76115a01fe57 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.201406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d22175-2e5b-462c-9a9b-76115a01fe57 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.201406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d22175-2e5b-462c-9a9b-76115a01fe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.219663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-05d22175-2e5b-462c-9a9b-76115a01fe57 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.220888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-05d22175-2e5b-462c-9a9b-76115a01fe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.245728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 793/1551] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.246989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f8fae-16cd-499b-9c61-d5382d4c7769 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.247282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f8fae-16cd-499b-9c61-d5382d4c7769 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.247800 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f8fae-16cd-499b-9c61-d5382d4c7769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.268414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0f2f8fae-16cd-499b-9c61-d5382d4c7769 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.269647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0f2f8fae-16cd-499b-9c61-d5382d4c7769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.284675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 759/1552] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.285686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d22175-2e5b-462c-9a9b-76115a01fe57 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.296710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d22175-2e5b-462c-9a9b-76115a01fe57 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.302452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f0030-1c27-4157-af7e-df143587d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.303100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0030-1c27-4157-af7e-df143587d11e admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.303388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0030-1c27-4157-af7e-df143587d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.303664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0030-1c27-4157-af7e-df143587d11e admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.304449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f0030-1c27-4157-af7e-df143587d11e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:07.304758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f0030-1c27-4157-af7e-df143587d11e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.306490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f0030-1c27-4157-af7e-df143587d11e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.326093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 760/1553] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:07.326093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790dec3-f780-4333-82cb-9b780e6b6339 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.326093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790dec3-f780-4333-82cb-9b780e6b6339 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.326093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790dec3-f780-4333-82cb-9b780e6b6339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.341063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a790dec3-f780-4333-82cb-9b780e6b6339 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.343047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a790dec3-f780-4333-82cb-9b780e6b6339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.345310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 794/1554] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.346584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8764-8c86-4dca-9384-32256b94e589 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.346948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8764-8c86-4dca-9384-32256b94e589 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.347234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8764-8c86-4dca-9384-32256b94e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.357032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 761/1555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.358786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790dec3-f780-4333-82cb-9b780e6b6339 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.370509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790dec3-f780-4333-82cb-9b780e6b6339 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.370748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-14fd8764-8c86-4dca-9384-32256b94e589 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.371920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-14fd8764-8c86-4dca-9384-32256b94e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.375771 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.376380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.376662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.376965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.377602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.379583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.380489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 795/1556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.381277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd8764-8c86-4dca-9384-32256b94e589 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.391642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd8764-8c86-4dca-9384-32256b94e589 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.396577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc877-de3d-482d-a645-dd2c61461bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.404996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc877-de3d-482d-a645-dd2c61461bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.404996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc877-de3d-482d-a645-dd2c61461bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.404996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc877-de3d-482d-a645-dd2c61461bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.404996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc877-de3d-482d-a645-dd2c61461bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.404996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING py.warnings [None req-a88bc877-de3d-482d-a645-dd2c61461bb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:07.404996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 20:21:07.404996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: Aug 17 20:21:07.405902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc877-de3d-482d-a645-dd2c61461bb6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.516216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 762/1557] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:07.516972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.526927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e5d69-2987-43f6-aa30-fbdd118b9b9b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.532295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.532889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.533167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.533438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.534075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:07.534378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.535987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.544257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 796/1558] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:07.548315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f162397-58de-44a4-944b-68c1d96dbec1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.548315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f162397-58de-44a4-944b-68c1d96dbec1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.548315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f162397-58de-44a4-944b-68c1d96dbec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.549786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 763/1559] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:07.557342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.560725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516f046-c21c-43e6-9026-c38c4cc0254e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.565557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.566165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.566444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.566750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.567377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.569317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.575459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5f162397-58de-44a4-944b-68c1d96dbec1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.577384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5f162397-58de-44a4-944b-68c1d96dbec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.585431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 797/1560] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.588728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2d4f-0520-4f05-85c1-e891b7da6897 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.588728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2d4f-0520-4f05-85c1-e891b7da6897 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.588728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2d4f-0520-4f05-85c1-e891b7da6897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.611954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a1bb2d4f-0520-4f05-85c1-e891b7da6897 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.613155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a1bb2d4f-0520-4f05-85c1-e891b7da6897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.621365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 798/1561] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.630237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda19af-79eb-4aa7-997f-dafefb53577b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.630237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda19af-79eb-4aa7-997f-dafefb53577b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.630237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda19af-79eb-4aa7-997f-dafefb53577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.630941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:07.644121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0dda19af-79eb-4aa7-997f-dafefb53577b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.645336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0dda19af-79eb-4aa7-997f-dafefb53577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.653229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 799/1562] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.655165 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af869-64b4-4167-bcb9-7b59c804a9cf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.655452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af869-64b4-4167-bcb9-7b59c804a9cf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.655709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af869-64b4-4167-bcb9-7b59c804a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.674729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c89af869-64b4-4167-bcb9-7b59c804a9cf None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:07.675954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c89af869-64b4-4167-bcb9-7b59c804a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:07.684013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 800/1563] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:07.684823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af869-64b4-4167-bcb9-7b59c804a9cf None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.692609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 764/1564] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:07.693602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.694614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af869-64b4-4167-bcb9-7b59c804a9cf None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.736054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:07.755300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.756113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.756389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.756670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.757776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.759428 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.760095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8ee5-3588-428d-8ea7-a9177a74eebe admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.765349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.766024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.766363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.766584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.767255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.768864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.769914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 801/1565] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:07.770869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.783343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 765/1566] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:07.784568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165c77-f308-4843-b126-fedb1803576f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.784826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.790334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.790968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.791250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.791519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.792141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.794043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.796677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efe08d-8df9-4eca-8429-28ac394e7840 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.801829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.802439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.802762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.803040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.803692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:07.804003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.806117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.818980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 766/1567] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:07.823063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.833954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c8807-7556-4665-aed9-39a952f01200 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.839144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.839724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.840064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.840348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.841052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:07.841306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.843567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.855897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 767/1568] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:07.857503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.868078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b6944-97da-4780-be47-e01afcaddfe0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.873270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.873975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.874263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.874546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.875232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:07.875544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.877133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.890038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 768/1569] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:07.890870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.900689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065073fd-ce29-42ce-98ff-532b5344f415 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.906346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 802/1570] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:07.906474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.911176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.911301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.911414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.911414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.911414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:07.911414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.911414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.923320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 769/1571] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:07.924287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:07.934360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7e41-a844-4ae6-a180-c96de88b85d4 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.990066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a119b-4c2a-4efa-a8ba-f50323fed9e3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:07.994770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.995398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:07.995522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.995685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.995963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.996065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:07.996287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:07.996569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:07.996659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.997214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:07.999083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:07.999376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.009811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 770/1572] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:08.010663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.020963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04359e-b317-46bf-b8fd-46b53b3b34c9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.025505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.026099 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.026385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.026752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.027343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.028958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.039051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 771/1573] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:08.039825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.049384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed11d0-779e-49d8-b1ba-beb6840f79bf admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.054081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.054707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.056111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.056111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.056111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.057868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.156398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 803/1574] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:07 2022] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:08.157357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.167281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d5500-159c-4ef8-b843-3852ebac40de admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.172111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.172732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.173014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.173296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.173922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.175859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.197203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 772/1575] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:08.198094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.241065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:08.261518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df211795-1f40-4b38-bafa-2782319805d2 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.267271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.267891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.268175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.268490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.269115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.271173 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.299096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 804/1576] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:08.300122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.334203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:08.369436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ab955-fa12-42f3-b5b4-ed12557f7a86 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.375113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.375768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.376065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.376344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.376992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.379025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.391743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 773/1577] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:08.392620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.454267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70969380-9d9e-420f-8486-df1d0bb553ab admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.459153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.459763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.460041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.460313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.461014 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.462954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.491795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 805/1578] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:08.492665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.503597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36192da8-1eac-434e-8780-d9a88cc632c2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.508598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.509248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.509536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.509808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] PATH_INFO: `/v3/projects/f95e63e2fad24821953b5549e26f9dbd/users/acd37d5161b247139f337ef0bf50a764/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.525505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95e63e2fad24821953b5549e26f9dbd, user_id=acd37d5161b247139f337ef0bf50a764, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.528180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.608178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 774/1579] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/projects => generated 357 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:08.609181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.671039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b033689-ed51-473b-9254-59d04f232461 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.679048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 806/1580] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:08 2022] PUT /identity/v3/projects/f95e63e2fad24821953b5549e26f9dbd/users/acd37d5161b247139f337ef0bf50a764/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:08.680265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.730363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:08.737123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.737788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.738087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.738344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] PATH_INFO: `/v3/projects/5ee573df90244e76a7ff255a0d8d88ef/users/c339948fd8e64dd0afeaddbe8c5eb533/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.745273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb320a66-ef98-4898-b5d4-57f4afaadf6b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.750386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.751046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.751311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.751585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.752296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.753505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee573df90244e76a7ff255a0d8d88ef, user_id=c339948fd8e64dd0afeaddbe8c5eb533, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.753846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.754543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:08.754543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:21:08.754543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:21:08.756779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.764228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 807/1581] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:08.764967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.774685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba3ebe-cc39-4144-9521-7aeaad071da8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.779835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.780325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.780604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.780880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.781495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.783424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.864871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 775/1582] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:08 2022] PUT /identity/v3/projects/5ee573df90244e76a7ff255a0d8d88ef/users/c339948fd8e64dd0afeaddbe8c5eb533/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:08.865684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.913442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 808/1583] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:08.913442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:08.921796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf275-420c-478c-80ef-97a4f7604f80 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.926567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.927217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.927506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.927798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.928315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec752be-94d6-488c-ac1d-2e2ab3bf2b70 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:08.928438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.930365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:08.933011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:08.933611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:08.933893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:08.934164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:08.934832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:08.937252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.056079 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 809/1584] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:09.056948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.065776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 776/1585] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:08 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:09.066783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.071651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eca4fd-2775-4791-af01-fcf4f4b3f9f3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.077488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd24642-cfe9-44ec-9311-c765e5dc8cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.078280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd24642-cfe9-44ec-9311-c765e5dc8cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.078503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb42f-5257-4c81-a2e0-98f9cbad94ce admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.078638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd24642-cfe9-44ec-9311-c765e5dc8cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.078854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd24642-cfe9-44ec-9311-c765e5dc8cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.079630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd24642-cfe9-44ec-9311-c765e5dc8cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.081240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd24642-cfe9-44ec-9311-c765e5dc8cfc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.083604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.084320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.084601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.084873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.085503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.087772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.096545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 810/1586] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.096545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc993a0-e74f-4d54-8583-51bf2dbef9cc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.096545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc993a0-e74f-4d54-8583-51bf2dbef9cc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.096545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc993a0-e74f-4d54-8583-51bf2dbef9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.115361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3cc993a0-e74f-4d54-8583-51bf2dbef9cc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:09.116592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3cc993a0-e74f-4d54-8583-51bf2dbef9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:09.124886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 811/1587] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:09.125885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc993a0-e74f-4d54-8583-51bf2dbef9cc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.137242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc993a0-e74f-4d54-8583-51bf2dbef9cc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.142860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857532-1d42-413b-8861-84d089a665ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.143520 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857532-1d42-413b-8861-84d089a665ce admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.143801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857532-1d42-413b-8861-84d089a665ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.144071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857532-1d42-413b-8861-84d089a665ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.144721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37857532-1d42-413b-8861-84d089a665ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.146391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37857532-1d42-413b-8861-84d089a665ce admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.158232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 812/1588] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.159579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76efc40-7178-4c77-a339-b09964456523 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.159914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76efc40-7178-4c77-a339-b09964456523 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.160195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76efc40-7178-4c77-a339-b09964456523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.190906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f76efc40-7178-4c77-a339-b09964456523 None None] MFA Rules not processed for user `c339948fd8e64dd0afeaddbe8c5eb533`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:09.192228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f76efc40-7178-4c77-a339-b09964456523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:09.208257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 777/1589] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:09 2022] POST /identity/v3/users => generated 279 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:09.209125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.210936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:09.221924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ce73c-94a9-4d47-aaeb-0bb11ee62379 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.226677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.227296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.227583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.227861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.228602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.230283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.241595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 778/1590] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.242511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.252333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee8120-552c-4fd2-a6f0-e11555b231bd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.257750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.258357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.258659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.258947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.259592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.261193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.266910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 813/1591] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:09.267764 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76efc40-7178-4c77-a339-b09964456523 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.274333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 779/1592] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.278206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.284870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76efc40-7178-4c77-a339-b09964456523 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.289186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c530fed-0a8d-4c07-af43-58ae77c42922 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.289685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.290313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.290592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.290902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.291608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.293243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.294357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.295055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.295339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.295822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.296474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.298603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.304562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 814/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.305228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.309873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 780/1594] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.310941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.321389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acf97f-9f0b-41e0-9ae1-4aa5f2fbce45 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.327257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19c7f-cfbe-4e92-9579-26c373239756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.327930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19c7f-cfbe-4e92-9579-26c373239756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.328235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19c7f-cfbe-4e92-9579-26c373239756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.328540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19c7f-cfbe-4e92-9579-26c373239756 admin admin] PATH_INFO: `/v3/projects/934251b859d143b394faf2e4ee44d8a1/users/a6cb1c446c3149e0bf92ebf5c5b78669/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.344997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19c7f-cfbe-4e92-9579-26c373239756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934251b859d143b394faf2e4ee44d8a1, user_id=a6cb1c446c3149e0bf92ebf5c5b78669, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.347891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19c7f-cfbe-4e92-9579-26c373239756 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.369829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4af19-c3c5-40a7-bf9d-1959c480ae7c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.374564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.375339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.375726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.376069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.386267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.387748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.398439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 815/1595] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:09.399305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.409409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded3173-d108-4c3d-ad13-b6d2f73097b2 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.414204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.414909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.415159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.415436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.416080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.417692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.428618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 816/1596] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.429455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.439492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d292e6-8b0c-4ee5-a115-18c9b274b290 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.444130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.444726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.445011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.445292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.445938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.447553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.458684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 817/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.459509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.470064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be17a25-5019-4709-af71-4b79d557b2ff admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.475972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 781/1598] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:09 2022] PUT /identity/v3/projects/934251b859d143b394faf2e4ee44d8a1/users/a6cb1c446c3149e0bf92ebf5c5b78669/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:09.477633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439bb4-cd90-47b1-b067-e7e57e69a806 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.478479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439bb4-cd90-47b1-b067-e7e57e69a806 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.478479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439bb4-cd90-47b1-b067-e7e57e69a806 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.479826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 782/1599] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 17 20:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:09.483508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439bb4-cd90-47b1-b067-e7e57e69a806 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.539284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.539915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.540199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.540480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.541161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.543007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.552827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:09.554208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 818/1600] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.554927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.560017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439bb4-cd90-47b1-b067-e7e57e69a806 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.566485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f689b-34ca-4bc7-a3d2-6b833b3ce41a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.566716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.567181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.567515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.567794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.568554 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.570283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.571877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bde30-09a6-4a55-9ee3-1ec78493c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.572649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bde30-09a6-4a55-9ee3-1ec78493c0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.573245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bde30-09a6-4a55-9ee3-1ec78493c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.573245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bde30-09a6-4a55-9ee3-1ec78493c0d6 admin admin] PATH_INFO: `/v3/projects/64b460fadf7a4e248f29bf520316bf1a/users/b9e5a2de79e64520a471abc3540d1922/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.585397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 783/1601] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.585397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.594757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bde30-09a6-4a55-9ee3-1ec78493c0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b460fadf7a4e248f29bf520316bf1a, user_id=b9e5a2de79e64520a471abc3540d1922, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.598871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c577c1-0f12-42ce-9c10-1f2f9623005b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.599017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bde30-09a6-4a55-9ee3-1ec78493c0d6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.600967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.601587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.601878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.602160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.602852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.604505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.615564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 784/1602] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:09.616421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.626856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256c8c-9264-4ad6-971b-91e789c0d108 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.631833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69715-2b2d-41cc-bfb0-6b6f750816d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.632765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69715-2b2d-41cc-bfb0-6b6f750816d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.632765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69715-2b2d-41cc-bfb0-6b6f750816d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.633026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69715-2b2d-41cc-bfb0-6b6f750816d9 admin admin] PATH_INFO: `/v3/projects/5cfb82b844d74f6586ee902fe17d9029/users/7f9c957933384fc3b1bbf5abbc0869c3/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.649548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69715-2b2d-41cc-bfb0-6b6f750816d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfb82b844d74f6586ee902fe17d9029, user_id=7f9c957933384fc3b1bbf5abbc0869c3, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.652290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69715-2b2d-41cc-bfb0-6b6f750816d9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.734373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:09.739411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 819/1603] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:09 2022] PUT /identity/v3/projects/64b460fadf7a4e248f29bf520316bf1a/users/b9e5a2de79e64520a471abc3540d1922/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:09.742039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266672f-c55a-49f2-ad20-30019a5cd5d5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.742039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266672f-c55a-49f2-ad20-30019a5cd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.742039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266672f-c55a-49f2-ad20-30019a5cd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.761097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9266672f-c55a-49f2-ad20-30019a5cd5d5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:09.762557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9266672f-c55a-49f2-ad20-30019a5cd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:09.791062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 785/1604] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:09 2022] PUT /identity/v3/projects/5cfb82b844d74f6586ee902fe17d9029/users/7f9c957933384fc3b1bbf5abbc0869c3/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:09.792466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f44f5-5e70-405e-a123-dfbb13a0472b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.792762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f44f5-5e70-405e-a123-dfbb13a0472b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.802781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f44f5-5e70-405e-a123-dfbb13a0472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.853094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-582f44f5-5e70-405e-a123-dfbb13a0472b None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:09.853094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-582f44f5-5e70-405e-a123-dfbb13a0472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:09.853386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 820/1605] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:09.853386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266672f-c55a-49f2-ad20-30019a5cd5d5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.865069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266672f-c55a-49f2-ad20-30019a5cd5d5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.928956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 786/1606] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 17 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:09.929828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f44f5-5e70-405e-a123-dfbb13a0472b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:09.942909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.943614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.943903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.944193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] PATH_INFO: `/v3/projects/489cb30d561c4b6591f8cf6fb74e1ee3/users/8cacffb3524f4f8ea97946e5e4af1ac3/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:09.962989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=489cb30d561c4b6591f8cf6fb74e1ee3, user_id=8cacffb3524f4f8ea97946e5e4af1ac3, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:09.965656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:09.992363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f44f5-5e70-405e-a123-dfbb13a0472b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:09.996893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e49e9-0a06-48cb-bbad-b24474c1ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:09.997569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e49e9-0a06-48cb-bbad-b24474c1ef3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:09.998461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e49e9-0a06-48cb-bbad-b24474c1ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:09.998844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e49e9-0a06-48cb-bbad-b24474c1ef3b admin admin] PATH_INFO: `/v3/projects/2e21a797dfb14b448d787ed516fd4abe/users/ae007a5ecc3d4116b2a35b3773e9ece4/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.013500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e49e9-0a06-48cb-bbad-b24474c1ef3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e21a797dfb14b448d787ed516fd4abe, user_id=ae007a5ecc3d4116b2a35b3773e9ece4, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:10.018393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e49e9-0a06-48cb-bbad-b24474c1ef3b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:10.097058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 821/1607] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:09 2022] PUT /identity/v3/projects/489cb30d561c4b6591f8cf6fb74e1ee3/users/8cacffb3524f4f8ea97946e5e4af1ac3/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:10.097058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.149269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4457ac1-577d-40e6-8798-c074d44fecbc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:10.163126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 787/1608] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:09 2022] PUT /identity/v3/projects/2e21a797dfb14b448d787ed516fd4abe/users/ae007a5ecc3d4116b2a35b3773e9ece4/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:10.165183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442ad1b-d840-4a85-9d14-4994b9b9c1f7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.165685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442ad1b-d840-4a85-9d14-4994b9b9c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.166156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442ad1b-d840-4a85-9d14-4994b9b9c1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.215144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5442ad1b-d840-4a85-9d14-4994b9b9c1f7 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:10.216902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5442ad1b-d840-4a85-9d14-4994b9b9c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:10.233875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.247956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.251987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:10.251987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.251987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.251987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] PATH_INFO: `/v3/projects/15de085680074e8d9206dff0ea120a63/users/973003011682498e88398abaedea730a/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.267339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15de085680074e8d9206dff0ea120a63, user_id=973003011682498e88398abaedea730a, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:10.270489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:10.287814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 788/1609] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:10.289265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.289556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.289857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.319072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] MFA Rules not processed for user `7f9c957933384fc3b1bbf5abbc0869c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:10.320313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:10.393819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 789/1610] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:10.393819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.393819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:10.394210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 822/1611] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:10 2022] PUT /identity/v3/projects/15de085680074e8d9206dff0ea120a63/users/973003011682498e88398abaedea730a/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:10.394313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.464121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66c51-f683-427f-b6a7-5391b352c6f7 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:10.480190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43909-aa07-4312-959a-d609ae9bded4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:10.487300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fc708-f795-4a7f-8b72-f04b4d2baa58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:10.487935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc708-f795-4a7f-8b72-f04b4d2baa58 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.488219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc708-f795-4a7f-8b72-f04b4d2baa58 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.488514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc708-f795-4a7f-8b72-f04b4d2baa58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.525650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b96e-8127-4d88-810e-f71a21eb5f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:10.526391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b96e-8127-4d88-810e-f71a21eb5f68 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.526698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b96e-8127-4d88-810e-f71a21eb5f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.526973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b96e-8127-4d88-810e-f71a21eb5f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.550487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.555958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fc708-f795-4a7f-8b72-f04b4d2baa58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:10.557582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fc708-f795-4a7f-8b72-f04b4d2baa58 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:10.568167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 823/1612] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:10.570528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48664e46-b883-4bee-b799-7e8dc2f55a42 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.571137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48664e46-b883-4bee-b799-7e8dc2f55a42 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.571615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48664e46-b883-4bee-b799-7e8dc2f55a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.598288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b96e-8127-4d88-810e-f71a21eb5f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:10.599905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b96e-8127-4d88-810e-f71a21eb5f68 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:10.601728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-48664e46-b883-4bee-b799-7e8dc2f55a42 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:10.603697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-48664e46-b883-4bee-b799-7e8dc2f55a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:10.611080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 790/1613] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:10.612589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9d7a-2f5a-4549-8243-d4e244029d92 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.612853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9d7a-2f5a-4549-8243-d4e244029d92 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.618591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9d7a-2f5a-4549-8243-d4e244029d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.618837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 824/1614] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:10.618837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48664e46-b883-4bee-b799-7e8dc2f55a42 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.634595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48664e46-b883-4bee-b799-7e8dc2f55a42 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:10.641509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:10.642484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.642998 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.643474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.659799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-fd4e9d7a-2f5a-4549-8243-d4e244029d92 None None] MFA Rules not processed for user `ae007a5ecc3d4116b2a35b3773e9ece4`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:10.661302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fd4e9d7a-2f5a-4549-8243-d4e244029d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:10.662328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:10.667423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:10.688825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 825/1615] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:10.695523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.707712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa00b-cfd4-40bb-9e29-8e0faaeb524e service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:10.715521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79187b3-0e5e-48bc-aa55-2ddcd87efe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:10.717298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79187b3-0e5e-48bc-aa55-2ddcd87efe2e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.717785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79187b3-0e5e-48bc-aa55-2ddcd87efe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.718262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79187b3-0e5e-48bc-aa55-2ddcd87efe2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.719379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79187b3-0e5e-48bc-aa55-2ddcd87efe2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:10.723147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79187b3-0e5e-48bc-aa55-2ddcd87efe2e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:10.768637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 791/1616] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:10.771429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776129c7-3336-4958-b674-e2185e5a8f75 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.771870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776129c7-3336-4958-b674-e2185e5a8f75 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.772151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776129c7-3336-4958-b674-e2185e5a8f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.809719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-776129c7-3336-4958-b674-e2185e5a8f75 None None] MFA Rules not processed for user `973003011682498e88398abaedea730a`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:10.811067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-776129c7-3336-4958-b674-e2185e5a8f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:10.890845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 792/1617] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:10.896643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776129c7-3336-4958-b674-e2185e5a8f75 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.902958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776129c7-3336-4958-b674-e2185e5a8f75 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:10.907513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:10.908196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.908658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 826/1618] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:10.911040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1317b-70db-42d6-9880-966c33f5fd9d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:10.911916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1317b-70db-42d6-9880-966c33f5fd9d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.912192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:10.912427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1317b-70db-42d6-9880-966c33f5fd9d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.912611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:10.914971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 827/1619] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 17 20:21:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:10.916151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1317b-70db-42d6-9880-966c33f5fd9d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.927501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:10.929986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:10.942621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.945364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 793/1620] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:10.946604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:10.959090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b036-2344-4a7a-9796-dceae5270272 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:10.985270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:11.045141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf00da-f42b-4b03-bcf6-26b345703969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.046246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf00da-f42b-4b03-bcf6-26b345703969 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.047028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf00da-f42b-4b03-bcf6-26b345703969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.047223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1317b-70db-42d6-9880-966c33f5fd9d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:11.047400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf00da-f42b-4b03-bcf6-26b345703969 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.048007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf00da-f42b-4b03-bcf6-26b345703969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.051067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf00da-f42b-4b03-bcf6-26b345703969 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.061815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a483e1-bf72-4468-9025-95676da98769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.061815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a483e1-bf72-4468-9025-95676da98769 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.061815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a483e1-bf72-4468-9025-95676da98769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.061815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a483e1-bf72-4468-9025-95676da98769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.062608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a483e1-bf72-4468-9025-95676da98769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.063080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a483e1-bf72-4468-9025-95676da98769 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.190893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 794/1621] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:11.190893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207f4b0-e8d3-4ba6-acd4-b2b73a5a48bb None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.190893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207f4b0-e8d3-4ba6-acd4-b2b73a5a48bb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.190893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207f4b0-e8d3-4ba6-acd4-b2b73a5a48bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.199332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 828/1622] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:10 2022] POST /identity/v3/projects => generated 357 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:11.200983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5be9c-d63c-4321-9093-a1e01abb0de1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.201286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5be9c-d63c-4321-9093-a1e01abb0de1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.201608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5be9c-d63c-4321-9093-a1e01abb0de1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.203842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 829/1623] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 17 20:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:11.204956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5be9c-d63c-4321-9093-a1e01abb0de1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:11.223262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f207f4b0-e8d3-4ba6-acd4-b2b73a5a48bb None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:11.224805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f207f4b0-e8d3-4ba6-acd4-b2b73a5a48bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:11.304289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5be9c-d63c-4321-9093-a1e01abb0de1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:11.324215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.325332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.326323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.327334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.328445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.331837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.373778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 830/1624] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:11.385409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:11.397054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 795/1625] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 17 20:21:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:11.400765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689124-2304-4886-93ca-224cee5d70c6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:11.410192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.410926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc9a0-85ab-434e-8607-251d6ef02624 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.411264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.411470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc9a0-85ab-434e-8607-251d6ef02624 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.411888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc9a0-85ab-434e-8607-251d6ef02624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.412139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.412618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.413445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.419916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.459930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f71cc9a0-85ab-434e-8607-251d6ef02624 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:11.461596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f71cc9a0-85ab-434e-8607-251d6ef02624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:11.478940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 796/1626] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:11.480507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc9a0-85ab-434e-8607-251d6ef02624 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:11.492082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc9a0-85ab-434e-8607-251d6ef02624 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:11.497243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.498797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.499214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.499582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] PATH_INFO: `/v3/projects/822618f36cb04b27813874c6d1665543/users/c19234ab861a476b81c4b252ab3315b7/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.519183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822618f36cb04b27813874c6d1665543, user_id=c19234ab861a476b81c4b252ab3315b7, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.522144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.610084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 831/1627] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:11 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:11.613592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:11.627452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4a47e-c25b-47c5-9b22-ce7ccf9e941f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:11.643249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 797/1628] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:11 2022] PUT /identity/v3/projects/822618f36cb04b27813874c6d1665543/users/c19234ab861a476b81c4b252ab3315b7/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:11.643249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:11.784907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d7fc-0224-47a3-8c03-c73b0f25a7e7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:11.795746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.798495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.798495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.799464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.804893 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.806174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.807989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.807989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.820030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.821653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.829147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:11.835050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 798/1629] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:11.836134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:11.854516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:11.939868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.943760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.949038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026e9e-edd6-4715-a41d-b87a65b2dbbf service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:11.966036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:11.967756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:11.968222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:11.968668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:11.969685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:11.971828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:11.975799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 832/1630] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:11.976943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:11.999843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 799/1631] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:12.004474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:12.013393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60948-b039-4a4b-b909-303c6cb7e2a7 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:12.031494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:12.032280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.032676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.033045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.033798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:12.035413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd16f2-b451-4b26-b87d-3afb9348af7c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:12.036161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:12.049547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:12.050547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.051039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.051475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] PATH_INFO: `/v3/projects/c89c2889f1054d6bad06dbd7b086a81d/users/e54b09ddfb8b4c7384f302efb732bfb0/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.068203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 833/1632] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:12.070580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:12.088892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89c2889f1054d6bad06dbd7b086a81d, user_id=e54b09ddfb8b4c7384f302efb732bfb0, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:12.093150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:12.097430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48771f7-e83f-4915-8ce4-fccc61b464f1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:12.111796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448a873-b073-4bce-a19e-fc06cd577bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:12.112839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448a873-b073-4bce-a19e-fc06cd577bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.113222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448a873-b073-4bce-a19e-fc06cd577bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.113600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448a873-b073-4bce-a19e-fc06cd577bce admin admin] PATH_INFO: `/v3/projects/822618f36cb04b27813874c6d1665543/users/c19234ab861a476b81c4b252ab3315b7/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.118671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448a873-b073-4bce-a19e-fc06cd577bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=822618f36cb04b27813874c6d1665543, user_id=c19234ab861a476b81c4b252ab3315b7, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:12.124313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448a873-b073-4bce-a19e-fc06cd577bce admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:12.141606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 834/1633] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:12 2022] PUT /identity/v3/projects/822618f36cb04b27813874c6d1665543/users/c19234ab861a476b81c4b252ab3315b7/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:12.151997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06cb4a-5aad-4a60-a074-ff65e92e62ab None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.155200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06cb4a-5aad-4a60-a074-ff65e92e62ab None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.155662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06cb4a-5aad-4a60-a074-ff65e92e62ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.229403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0c06cb4a-5aad-4a60-a074-ff65e92e62ab None None] MFA Rules not processed for user `c19234ab861a476b81c4b252ab3315b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:12.230323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 800/1634] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:12 2022] PUT /identity/v3/projects/c89c2889f1054d6bad06dbd7b086a81d/users/e54b09ddfb8b4c7384f302efb732bfb0/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:12.231389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:12.231802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0c06cb4a-5aad-4a60-a074-ff65e92e62ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:12.349981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 835/1635] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:12.671790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06cb4a-5aad-4a60-a074-ff65e92e62ab None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:12.673483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81559d7-353e-4b8d-8731-d5090323e3c0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:12.673483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487a1f0-fcee-4bad-a829-4ad1adc3d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:12.673483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487a1f0-fcee-4bad-a829-4ad1adc3d9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.673483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487a1f0-fcee-4bad-a829-4ad1adc3d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.675595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487a1f0-fcee-4bad-a829-4ad1adc3d9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.675595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487a1f0-fcee-4bad-a829-4ad1adc3d9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:12.675595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487a1f0-fcee-4bad-a829-4ad1adc3d9e3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:12.675595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 801/1636] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:12.675595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675740-c4dc-4ea6-b696-b20f26d1c49e None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.675595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675740-c4dc-4ea6-b696-b20f26d1c49e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.676030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675740-c4dc-4ea6-b696-b20f26d1c49e None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.676030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 802/1637] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 17 20:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:12.676030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675740-c4dc-4ea6-b696-b20f26d1c49e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:12.676030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675740-c4dc-4ea6-b696-b20f26d1c49e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:12.676767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ce12c-9d6b-43cd-a0d2-eea492f1da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:12.676767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce12c-9d6b-43cd-a0d2-eea492f1da11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.676767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce12c-9d6b-43cd-a0d2-eea492f1da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.676767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce12c-9d6b-43cd-a0d2-eea492f1da11 admin admin] PATH_INFO: `/v3/projects/c89c2889f1054d6bad06dbd7b086a81d/users/e54b09ddfb8b4c7384f302efb732bfb0/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.677446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06cb4a-5aad-4a60-a074-ff65e92e62ab None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:12.677882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ce12c-9d6b-43cd-a0d2-eea492f1da11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89c2889f1054d6bad06dbd7b086a81d, user_id=e54b09ddfb8b4c7384f302efb732bfb0, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:12.677945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312f041-6be6-4090-830f-5542aa73e704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:12.677945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f041-6be6-4090-830f-5542aa73e704 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.677945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f041-6be6-4090-830f-5542aa73e704 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.677945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f041-6be6-4090-830f-5542aa73e704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.678151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ce12c-9d6b-43cd-a0d2-eea492f1da11 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:12.678207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312f041-6be6-4090-830f-5542aa73e704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:12.678261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 803/1638] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:12 2022] PUT /identity/v3/projects/c89c2889f1054d6bad06dbd7b086a81d/users/e54b09ddfb8b4c7384f302efb732bfb0/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:12.678315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312f041-6be6-4090-830f-5542aa73e704 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:12.678376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3297f9-58de-4275-9dbc-bbdd5ff8f055 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.678376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3297f9-58de-4275-9dbc-bbdd5ff8f055 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.678376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3297f9-58de-4275-9dbc-bbdd5ff8f055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.678516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 836/1639] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:12.678516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb315-9c84-4705-aefc-dd35eb6d5e72 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.678516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb315-9c84-4705-aefc-dd35eb6d5e72 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.678516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb315-9c84-4705-aefc-dd35eb6d5e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.678516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-967eb315-9c84-4705-aefc-dd35eb6d5e72 None None] MFA Rules not processed for user `e54b09ddfb8b4c7384f302efb732bfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:12.678871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2c3297f9-58de-4275-9dbc-bbdd5ff8f055 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:12.678929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-967eb315-9c84-4705-aefc-dd35eb6d5e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:12.678986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2c3297f9-58de-4275-9dbc-bbdd5ff8f055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:12.695551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 837/1640] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:12.699562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 804/1641] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:12.868737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb315-9c84-4705-aefc-dd35eb6d5e72 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:12.955067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb315-9c84-4705-aefc-dd35eb6d5e72 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:12.962384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:12.963838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:12.963979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:12.964651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:12.979964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:12.980897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:13.012795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 838/1642] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:13.156161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc27df-4130-4334-8c16-4357e0e5f0e3 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:13.156678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc27df-4130-4334-8c16-4357e0e5f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:13.156757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc27df-4130-4334-8c16-4357e0e5f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:13.213287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:13.230896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:13.247262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f0e7-e2be-4166-b3d1-01312c681dcf service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:13.279720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:13.282808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:13.283029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:13.283297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:13.312917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:13.315060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:13.326411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f5cc27df-4130-4334-8c16-4357e0e5f0e3 None None] MFA Rules not processed for user `a6cb1c446c3149e0bf92ebf5c5b78669`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:13.327772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f5cc27df-4130-4334-8c16-4357e0e5f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:13.333375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 839/1643] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:13.554816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 805/1644] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:13.557196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:13.573164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:13.623227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc27df-4130-4334-8c16-4357e0e5f0e3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:13.646451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc27df-4130-4334-8c16-4357e0e5f0e3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:13.667312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:13.671269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:13.674143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:13.674491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:13.760380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9df901-2f6f-485d-b5c7-f4a0f100fb25 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:13.769875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:13.775505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:13.776097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:13.776482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:13.777476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:13.780003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:13.861928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:13.866047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:13.875937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 806/1645] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:13.877088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:13.887902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295645ab-d314-44e0-a0c4-7f4ada1ac0da service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:13.894404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:13.895380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:13.895849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:13.896230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:13.966878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 840/1646] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:13 2022] POST /identity/v3/projects => generated 405 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:13.970885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:14.007532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:14.009410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:14.032241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 807/1647] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:14.097766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0420b5a-cfe4-40a5-bf4d-515c7772fc05 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:14.104131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:14.105062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:14.105441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:14.105847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:14.106653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:14.109512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:14.242946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 841/1648] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:13 2022] POST /identity/v3/users => generated 309 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:14.250200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:14.274621 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb55950-ed0d-453a-bc2c-00fedd6f285e service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:14.286681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:14.286681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:14.286681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:14.286681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:14.287141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:14.287141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:14.303492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 808/1649] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:14.307514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:14.320769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bea04-62db-461f-83c6-8b62bed7f5f0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:14.327729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:14.328461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:14.328747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:14.329028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] PATH_INFO: `/v3/projects/d2a559abbb714f5eb9917449da74ae7c/users/96732e4a7a7d49f6a9b9cfd8a93445f2/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:14.359126 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a559abbb714f5eb9917449da74ae7c, user_id=96732e4a7a7d49f6a9b9cfd8a93445f2, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:14.377220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:14.512668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:14.513592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 842/1650] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:14 2022] PUT /identity/v3/projects/d2a559abbb714f5eb9917449da74ae7c/users/96732e4a7a7d49f6a9b9cfd8a93445f2/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:14.524933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d346e2f-3abf-4af1-bad1-cfcbae489176 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:14.605427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:14.606403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:14.607139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:14.608107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:14.609090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:14.611155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:14.632069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 809/1651] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:21:14.639258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:14.657830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0561-0325-4480-8bc0-9f53cae577a4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:14.670223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ca89-c213-46cb-ba6b-8a260ed319d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:14.674716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ca89-c213-46cb-ba6b-8a260ed319d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:14.675172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ca89-c213-46cb-ba6b-8a260ed319d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:14.675650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ca89-c213-46cb-ba6b-8a260ed319d1 admin admin] PATH_INFO: `/v3/projects/d2a559abbb714f5eb9917449da74ae7c/users/96732e4a7a7d49f6a9b9cfd8a93445f2/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:14.680148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ca89-c213-46cb-ba6b-8a260ed319d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a559abbb714f5eb9917449da74ae7c, user_id=96732e4a7a7d49f6a9b9cfd8a93445f2, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:14.683851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ca89-c213-46cb-ba6b-8a260ed319d1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:14.694948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:14.724229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 843/1652] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:14 2022] PUT /identity/v3/projects/d2a559abbb714f5eb9917449da74ae7c/users/96732e4a7a7d49f6a9b9cfd8a93445f2/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:14.788515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:14.811496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9e949-90d3-4fa2-9b14-83559cbb8f4e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:15.014568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:15.015423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:15.020233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:15.020705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] PATH_INFO: `/v3/users/ae007a5ecc3d4116b2a35b3773e9ece4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:15.023047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae007a5ecc3d4116b2a35b3773e9ece4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:15.024541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: WARNING py.warnings [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:15.024541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: warnings.warn(msg) Aug 17 20:21:15.024541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: Aug 17 20:21:15.026039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:15.321849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae007a5ecc3d4116b2a35b3773e9ece4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:15.370886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae007a5ecc3d4116b2a35b3773e9ece4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:15.374222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae007a5ecc3d4116b2a35b3773e9ece4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:15.487909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:15.488820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae007a5ecc3d4116b2a35b3773e9ece4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:15.489797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae007a5ecc3d4116b2a35b3773e9ece4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:15.521281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 810/1653] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:14 2022] DELETE /identity/v3/users/ae007a5ecc3d4116b2a35b3773e9ece4 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:15.522793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:15.523634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:15.524105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:15.545500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:15.546922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:15.689506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 844/1654] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:15.703109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:15.705407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:15.924965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0663-00e7-480b-920f-64a0900ef1c4 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:15.933662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4046b-5506-473b-b3b7-2fca70e545b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:15.935863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4046b-5506-473b-b3b7-2fca70e545b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:15.936331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4046b-5506-473b-b3b7-2fca70e545b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:15.936940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4046b-5506-473b-b3b7-2fca70e545b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:15.959404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4046b-5506-473b-b3b7-2fca70e545b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:15.967449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4046b-5506-473b-b3b7-2fca70e545b1 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:15.990375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:15.998307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 811/1655] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:17.123563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:17.125042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:17.153435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036f59-a534-4309-8e81-1ae64260f371 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:17.177709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:17.178475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:17.178812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:17.179089 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] PATH_INFO: `/v3/projects/2e21a797dfb14b448d787ed516fd4abe` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:17.180549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e21a797dfb14b448d787ed516fd4abe)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:17.181724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: WARNING py.warnings [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:17.181724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 20:21:17.181724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: Aug 17 20:21:17.183263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:17.453633 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e21a797dfb14b448d787ed516fd4abe', 'request_id': 'req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:17.481342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e21a797dfb14b448d787ed516fd4abe', 'request_id': 'req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:17.485396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:17.591858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e21a797dfb14b448d787ed516fd4abe', 'request_id': 'req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:17.650281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] The token cache is being invalidate because project 2e21a797dfb14b448d787ed516fd4abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:17.650580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:17.653445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bae779e7-a5e0-43fa-80f8-bffe05f59c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:17.667272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 845/1656] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:17 2022] DELETE /identity/v3/projects/2e21a797dfb14b448d787ed516fd4abe => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:17.673200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b250c-28bc-4a98-b361-287d9ea2bf87 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:17.673744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b250c-28bc-4a98-b361-287d9ea2bf87 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:17.673744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b250c-28bc-4a98-b361-287d9ea2bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:17.725300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-138b250c-28bc-4a98-b361-287d9ea2bf87 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:17.730545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-138b250c-28bc-4a98-b361-287d9ea2bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:18.004795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 812/1657] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:18.012643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ccdc-04dd-4e16-b357-4c0540042663 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:18.012992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ccdc-04dd-4e16-b357-4c0540042663 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:18.013276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ccdc-04dd-4e16-b357-4c0540042663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:18.063449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-66b4ccdc-04dd-4e16-b357-4c0540042663 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:18.065138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-66b4ccdc-04dd-4e16-b357-4c0540042663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:18.110192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 846/1658] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:18.114559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b250c-28bc-4a98-b361-287d9ea2bf87 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:18.147824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b250c-28bc-4a98-b361-287d9ea2bf87 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:18.167343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:18.169505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:18.169505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:18.169505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:18.169505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:18.169729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:18.174372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:18.207772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 813/1659] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:18.209051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4ccdc-04dd-4e16-b357-4c0540042663 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:18.223491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4ccdc-04dd-4e16-b357-4c0540042663 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:18.232443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:18.235368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:18.235938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:18.238574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:18.239579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:18.244603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:18.417264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 847/1660] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:18 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:21:18.421772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:18.440708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82fcb5-4185-47f4-8425-b32de1ea2a66 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:18.563762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:18.565360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:18.565650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:18.566031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:18.566754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:18.569025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:18.709281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 814/1661] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:18 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:18.713310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:18.729309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327db40-5c0b-4a82-89f6-20dba0d6b4c0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:18.750751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:18.754228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:18.755193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:18.755700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:18.757132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:18.760373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:18.791395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 848/1662] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:18.793151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:18.809343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1de7-4c57-46ca-9d84-8a598ceec2ec admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:18.823879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12a95-10f2-4742-b2eb-573875a7f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:18.824883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a95-10f2-4742-b2eb-573875a7f5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:18.826228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a95-10f2-4742-b2eb-573875a7f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:18.826803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a95-10f2-4742-b2eb-573875a7f5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:18.827925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12a95-10f2-4742-b2eb-573875a7f5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:18.830071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12a95-10f2-4742-b2eb-573875a7f5b8 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:18.855568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 815/1663] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:18.859375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:18.881524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729611f-d14e-4f57-8602-31da06d44fdf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:18.890959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57ba67-9a89-4846-8ebd-e8b44eb27881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:18.896902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57ba67-9a89-4846-8ebd-e8b44eb27881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:18.896902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57ba67-9a89-4846-8ebd-e8b44eb27881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:18.896902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57ba67-9a89-4846-8ebd-e8b44eb27881 admin admin] PATH_INFO: `/v3/projects/9e80941b87d64557a9d32e1fbf5f38a8/users/ee5616fa1efa4fe4ba21c0368ac66b5d/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:18.914401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57ba67-9a89-4846-8ebd-e8b44eb27881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e80941b87d64557a9d32e1fbf5f38a8, user_id=ee5616fa1efa4fe4ba21c0368ac66b5d, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:18.918898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57ba67-9a89-4846-8ebd-e8b44eb27881 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:19.036689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 849/1664] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:18 2022] PUT /identity/v3/projects/9e80941b87d64557a9d32e1fbf5f38a8/users/ee5616fa1efa4fe4ba21c0368ac66b5d/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:19.047923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58be4a-c3de-4375-9ea1-f7d2752867ae None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:19.048510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58be4a-c3de-4375-9ea1-f7d2752867ae None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:19.048510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58be4a-c3de-4375-9ea1-f7d2752867ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:19.068548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538de38-71c7-49a6-a7cb-43bfde6729fa None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:19.068548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538de38-71c7-49a6-a7cb-43bfde6729fa None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:19.068548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538de38-71c7-49a6-a7cb-43bfde6729fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:19.107535 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9b58be4a-c3de-4375-9ea1-f7d2752867ae None None] MFA Rules not processed for user `ee5616fa1efa4fe4ba21c0368ac66b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:19.109215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9b58be4a-c3de-4375-9ea1-f7d2752867ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:19.148995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7538de38-71c7-49a6-a7cb-43bfde6729fa None None] MFA Rules not processed for user `96732e4a7a7d49f6a9b9cfd8a93445f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:19.152859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7538de38-71c7-49a6-a7cb-43bfde6729fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:19.191973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:19.270601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 816/1665] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:19.276643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58be4a-c3de-4375-9ea1-f7d2752867ae None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:19.320765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 850/1666] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:19 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:19.512476 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58be4a-c3de-4375-9ea1-f7d2752867ae None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:19.538524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:19.539649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:19.540128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:19.540615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:19.546493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:19.550399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:19.793263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538de38-71c7-49a6-a7cb-43bfde6729fa None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:19.794031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 817/1667] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:19 2022] POST /identity/v3/projects => generated 371 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:19.812788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538de38-71c7-49a6-a7cb-43bfde6729fa None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:19.848866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:19.851717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:19.972079 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:19.972727 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:19.973844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:19.974160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:19.974855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:19.981280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:20.143144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 851/1668] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:19 2022] POST /identity/v3/users => generated 292 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:21:20.148560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:20.159232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0206a-8805-4fb4-9ebc-ddb82938f9d4 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:20.170491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450196-8f36-4a2d-8186-2afd63bb1f47 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:20.171774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:20.178760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:20.178760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:20.178760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] PATH_INFO: `/v3/users/7f9c957933384fc3b1bbf5abbc0869c3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:20.178760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9c957933384fc3b1bbf5abbc0869c3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:20.179462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:20.183556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:20.184194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:20.184476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:20.185272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:20.185940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:20.189711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:20.220144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 852/1669] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:20.224311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:20.251143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee2e6-073b-4516-a51a-dcefec0029da admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:20.257329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:20.258193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:20.258597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:20.258980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] PATH_INFO: `/v3/projects/e020dc26ace547d18d28458e7c3d4117/users/5205d6de48d44f748f6dcfeb373e0618/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:20.284246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e020dc26ace547d18d28458e7c3d4117, user_id=5205d6de48d44f748f6dcfeb373e0618, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:20.289474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:20.437557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 853/1670] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:20 2022] PUT /identity/v3/projects/e020dc26ace547d18d28458e7c3d4117/users/5205d6de48d44f748f6dcfeb373e0618/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:20.438846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:20.491585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9c957933384fc3b1bbf5abbc0869c3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:20.545773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9c957933384fc3b1bbf5abbc0869c3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:20.548704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9c957933384fc3b1bbf5abbc0869c3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:20.568506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:20.612579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82d74d-7d8a-4277-be85-8e1b65110606 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:20.618749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:20.619446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:20.619734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:20.620325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:20.620995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:20.622835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:20.647650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 854/1671] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:20.649210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:20.651426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:20.676053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9c957933384fc3b1bbf5abbc0869c3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:20.677253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6668ca25-a41e-4c2e-a38e-c1d07ec621c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9c957933384fc3b1bbf5abbc0869c3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:20.702873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 818/1672] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:19 2022] DELETE /identity/v3/users/7f9c957933384fc3b1bbf5abbc0869c3 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:20.706031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433de3a5-bf00-44fe-8935-766f116eadbe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:20.707572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:20.708338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:20.708674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:20.766003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:20.767543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:20.875564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8cd44-9674-4aad-9716-4458bc2dce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:20.877812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8cd44-9674-4aad-9716-4458bc2dce12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:20.878142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8cd44-9674-4aad-9716-4458bc2dce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:20.878425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8cd44-9674-4aad-9716-4458bc2dce12 admin admin] PATH_INFO: `/v3/projects/e020dc26ace547d18d28458e7c3d4117/users/5205d6de48d44f748f6dcfeb373e0618/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:20.887363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8cd44-9674-4aad-9716-4458bc2dce12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e020dc26ace547d18d28458e7c3d4117, user_id=5205d6de48d44f748f6dcfeb373e0618, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:20.899630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8cd44-9674-4aad-9716-4458bc2dce12 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:20.928821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 819/1673] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:20.929415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 855/1674] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:20 2022] PUT /identity/v3/projects/e020dc26ace547d18d28458e7c3d4117/users/5205d6de48d44f748f6dcfeb373e0618/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:20.947526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:20.949894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:20.951827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:20.953743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:20.954316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:21.010561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] MFA Rules not processed for user `5205d6de48d44f748f6dcfeb373e0618`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:21.012293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:21.045326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5e7e1-ab17-4794-95e9-952059b44e42 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:21.073700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:21.131983 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:21.143079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:21.143465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:21.143846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:21.175538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 856/1675] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:21.196238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:21.198566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:21.285770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:21.289484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:21.326672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 820/1676] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:21.355275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed8979-c49a-4a9f-a84e-3ab56ce283a2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:21.368900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b66cc-a029-4f85-b855-6b444a21590a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:21.370191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b66cc-a029-4f85-b855-6b444a21590a service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:21.370554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b66cc-a029-4f85-b855-6b444a21590a service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:21.370884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b66cc-a029-4f85-b855-6b444a21590a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:21.392898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b66cc-a029-4f85-b855-6b444a21590a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:21.395083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b66cc-a029-4f85-b855-6b444a21590a service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:21.417422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 857/1677] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:22.087774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:22.103227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f9b7f-d933-4be9-8dab-18240f12cd76 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:22.109152 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74f854-b535-4429-9b18-ac37e38dd8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:22.111188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f854-b535-4429-9b18-ac37e38dd8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:22.111717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f854-b535-4429-9b18-ac37e38dd8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:22.112259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f854-b535-4429-9b18-ac37e38dd8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:22.116862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fd74f854-b535-4429-9b18-ac37e38dd8f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:22.264101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74f854-b535-4429-9b18-ac37e38dd8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:22.265637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74f854-b535-4429-9b18-ac37e38dd8f9 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:22.295538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 821/1678] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:22.391336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:22.394548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:22.395383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:22.491932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] MFA Rules not processed for user `b9e5a2de79e64520a471abc3540d1922`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:22.493265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:22.690964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 858/1679] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:22.700723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:22.701059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:22.701370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:22.707809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:22.709712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:22.738739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7c9ac-d9fa-49d4-9600-d51cc5851b46 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:22.749869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] MFA Rules not processed for user `b9e5a2de79e64520a471abc3540d1922`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:22.753804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:22.755841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:22.756974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:22.757599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:22.758069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] PATH_INFO: `/v3/projects/5cfb82b844d74f6586ee902fe17d9029` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:22.761720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfb82b844d74f6586ee902fe17d9029)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:22.766578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:22.799038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 822/1680] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:22.805146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:22.824865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:22.920607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:23.030787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfb82b844d74f6586ee902fe17d9029', 'request_id': 'req-8cf2ff16-4599-4637-b0fb-098ef418acb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:23.047741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfb82b844d74f6586ee902fe17d9029', 'request_id': 'req-8cf2ff16-4599-4637-b0fb-098ef418acb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:23.109867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72588-e7b7-42c9-b111-24dce9197bc0 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:23.189886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfb82b844d74f6586ee902fe17d9029', 'request_id': 'req-8cf2ff16-4599-4637-b0fb-098ef418acb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:23.219078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] The token cache is being invalidate because project 5cfb82b844d74f6586ee902fe17d9029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:23.219377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:23.229851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8cf2ff16-4599-4637-b0fb-098ef418acb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:23.235405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 859/1681] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:22 2022] DELETE /identity/v3/projects/5cfb82b844d74f6586ee902fe17d9029 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:23.236981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92eaa-bdda-43f3-bee6-ff910c1e9d96 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.237624 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92eaa-bdda-43f3-bee6-ff910c1e9d96 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.238123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92eaa-bdda-43f3-bee6-ff910c1e9d96 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.244450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 860/1682] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:21:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:23.245509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c92eaa-bdda-43f3-bee6-ff910c1e9d96 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:23.254224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-94c92eaa-bdda-43f3-bee6-ff910c1e9d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:23.512441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca938d-b857-4ab3-8118-75edc29145fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:23.512441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca938d-b857-4ab3-8118-75edc29145fc service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.512799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca938d-b857-4ab3-8118-75edc29145fc service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.513025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca938d-b857-4ab3-8118-75edc29145fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.524994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ffca938d-b857-4ab3-8118-75edc29145fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:23.637103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca938d-b857-4ab3-8118-75edc29145fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:23.639798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca938d-b857-4ab3-8118-75edc29145fc service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:23.657354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 823/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 853 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:23.660571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbebc28-b589-4109-a227-700377361509 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.660903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbebc28-b589-4109-a227-700377361509 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.662711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbebc28-b589-4109-a227-700377361509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.687440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c92eaa-bdda-43f3-bee6-ff910c1e9d96 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:23.703822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:23.704315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.704608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.704889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] PATH_INFO: `/v3/users/c19234ab861a476b81c4b252ab3315b7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.706214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19234ab861a476b81c4b252ab3315b7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:23.708583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:23.738249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-cfbebc28-b589-4109-a227-700377361509 None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:23.743576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-cfbebc28-b589-4109-a227-700377361509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:23.912277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:24.034748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19234ab861a476b81c4b252ab3315b7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:24.102879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19234ab861a476b81c4b252ab3315b7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:24.107741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 824/1684] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:21:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.132418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19234ab861a476b81c4b252ab3315b7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:24.133691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19234ab861a476b81c4b252ab3315b7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:24.241627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b41e2007-3a30-482b-b58a-15580abcbbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19234ab861a476b81c4b252ab3315b7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:24.266010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 861/1685] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:23 2022] DELETE /identity/v3/users/c19234ab861a476b81c4b252ab3315b7 => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:24.431720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7649e2c-fd92-456c-ac02-5cd460a184ce None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.433513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7649e2c-fd92-456c-ac02-5cd460a184ce None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.434414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7649e2c-fd92-456c-ac02-5cd460a184ce None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.436463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 825/1686] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 17 20:21:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:21:24.460087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad289c-0e75-4245-9804-69cb5020461b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.460874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad289c-0e75-4245-9804-69cb5020461b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.461371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad289c-0e75-4245-9804-69cb5020461b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.513335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c8ad289c-0e75-4245-9804-69cb5020461b None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.523291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c8ad289c-0e75-4245-9804-69cb5020461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.636760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7649e2c-fd92-456c-ac02-5cd460a184ce None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.639172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 862/1687] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:24.659325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7649e2c-fd92-456c-ac02-5cd460a184ce None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.667707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fc698-9ac6-4241-8fee-26583cf80cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.673459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc698-9ac6-4241-8fee-26583cf80cb6 service placement] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.673459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc698-9ac6-4241-8fee-26583cf80cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.673459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc698-9ac6-4241-8fee-26583cf80cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.673459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2e0fc698-9ac6-4241-8fee-26583cf80cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.685626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fc698-9ac6-4241-8fee-26583cf80cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.687591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fc698-9ac6-4241-8fee-26583cf80cb6 service placement] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.710877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 826/1688] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:25.106066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:25.209318 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756892-15c3-41a9-ac68-b999b92799a8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.209684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756892-15c3-41a9-ac68-b999b92799a8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.210184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756892-15c3-41a9-ac68-b999b92799a8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.214586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 863/1689] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 17 20:21:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:25.243424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.243898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.244377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.370356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] MFA Rules not processed for user `765ee8241c4e448eb999016b17132e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:25.373006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.477166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16756892-15c3-41a9-ac68-b999b92799a8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.479355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16756892-15c3-41a9-ac68-b999b92799a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.508833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 827/1690] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:25.660492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16756892-15c3-41a9-ac68-b999b92799a8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.672663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.675534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.676186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.676625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] PATH_INFO: `/v3/users/c339948fd8e64dd0afeaddbe8c5eb533` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.678705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c339948fd8e64dd0afeaddbe8c5eb533)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.682097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.839385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.841157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.858027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d6e78-c5da-493b-87a2-639942a2cc7d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.864499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62296c-740d-40e3-aacf-39105f1cc193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.865136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62296c-740d-40e3-aacf-39105f1cc193 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.865420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62296c-740d-40e3-aacf-39105f1cc193 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.865698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62296c-740d-40e3-aacf-39105f1cc193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.878267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62296c-740d-40e3-aacf-39105f1cc193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.880617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62296c-740d-40e3-aacf-39105f1cc193 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.893652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 828/1691] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:26.059676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c339948fd8e64dd0afeaddbe8c5eb533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:26.097465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c339948fd8e64dd0afeaddbe8c5eb533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:26.123365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c339948fd8e64dd0afeaddbe8c5eb533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:26.125142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c339948fd8e64dd0afeaddbe8c5eb533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:26.222957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf7bca2d-5fda-4054-9967-ce1d8614388d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c339948fd8e64dd0afeaddbe8c5eb533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:26.232044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 864/1692] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:25 2022] DELETE /identity/v3/users/c339948fd8e64dd0afeaddbe8c5eb533 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:26.236969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.237263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.237711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.289722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4798-947f-4776-b76e-cbf434502fcb None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.290792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4798-947f-4776-b76e-cbf434502fcb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.291210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4798-947f-4776-b76e-cbf434502fcb None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.293179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 865/1693] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:21:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:26.311673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:26.311673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:26.358887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.359218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.361481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.425783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] MFA Rules not processed for user `2f3ab28e46424895b2c730edfdcc7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:26.428244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:26.516968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 829/1694] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:26.563767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.565373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:26.696648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 866/1695] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:26.717144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b4ad8-64dd-445c-bf9f-832d2e0881a0 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.722245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.723856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.724387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.724925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.727676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.730847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:26.740514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.743850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.752563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7da04-cf5a-44c5-9ad2-f18210263c66 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.780485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd578168-271f-493a-bfbb-736031c7250a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.781202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578168-271f-493a-bfbb-736031c7250a service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.781443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578168-271f-493a-bfbb-736031c7250a service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.782106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578168-271f-493a-bfbb-736031c7250a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.792058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:26.795665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 830/1696] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:26.796119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd578168-271f-493a-bfbb-736031c7250a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.797665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.797773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd578168-271f-493a-bfbb-736031c7250a service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.806194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:26.811339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 867/1697] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:26.843718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4970623-0d62-4dae-b28d-3f472e84adb3 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.863377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.874839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.875571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.876381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] PATH_INFO: `/v3/users/a6cb1c446c3149e0bf92ebf5c5b78669` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.881588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cb1c446c3149e0bf92ebf5c5b78669)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.887447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.050413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.050968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.051326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.092216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] MFA Rules not processed for user `acd37d5161b247139f337ef0bf50a764`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:27.094092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:27.217403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 868/1698] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:27.218556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.219880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:27.240996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b415c3-6885-4d85-bb6d-f1f6aff81e36 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.250269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.251068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.252020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.252320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] PATH_INFO: `/v3/projects/822618f36cb04b27813874c6d1665543` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.253942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822618f36cb04b27813874c6d1665543)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.270334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.325232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cb1c446c3149e0bf92ebf5c5b78669'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.366233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cb1c446c3149e0bf92ebf5c5b78669'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.368199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cb1c446c3149e0bf92ebf5c5b78669'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.468808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cb1c446c3149e0bf92ebf5c5b78669'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.469939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cb1c446c3149e0bf92ebf5c5b78669'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.492831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822618f36cb04b27813874c6d1665543', 'request_id': 'req-0d341cab-ead1-4739-8328-deb694874621'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.518334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 831/1699] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:26 2022] DELETE /identity/v3/users/a6cb1c446c3149e0bf92ebf5c5b78669 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:27.527557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.529136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822618f36cb04b27813874c6d1665543', 'request_id': 'req-0d341cab-ead1-4739-8328-deb694874621'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.531873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:27.635492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822618f36cb04b27813874c6d1665543', 'request_id': 'req-0d341cab-ead1-4739-8328-deb694874621'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.678373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] The token cache is being invalidate because project 822618f36cb04b27813874c6d1665543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:27.678842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.682639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:27.690176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 869/1700] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:27 2022] DELETE /identity/v3/projects/822618f36cb04b27813874c6d1665543 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:27.691277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.698406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:27.868197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34147fe4-3221-4142-997e-9e8185bc0a4d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.884716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b1ff0-9867-4b82-9e56-f5c508c6f8e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.885566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b1ff0-9867-4b82-9e56-f5c508c6f8e7 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.885875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b1ff0-9867-4b82-9e56-f5c508c6f8e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.886158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b1ff0-9867-4b82-9e56-f5c508c6f8e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.893542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1c6b1ff0-9867-4b82-9e56-f5c508c6f8e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:27.914328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d341cab-ead1-4739-8328-deb694874621 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.044388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:28.102309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b1ff0-9867-4b82-9e56-f5c508c6f8e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.104510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b1ff0-9867-4b82-9e56-f5c508c6f8e7 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.121908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.126593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.127111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.127425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.133849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:28.140790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:28.151287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 832/1701] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:28.152852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108155-2791-4caa-a921-e2b3526208a0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.153198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108155-2791-4caa-a921-e2b3526208a0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.154094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108155-2791-4caa-a921-e2b3526208a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.182293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.188639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.211521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 870/1702] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:28.236698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-8b108155-2791-4caa-a921-e2b3526208a0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:28.238077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8b108155-2791-4caa-a921-e2b3526208a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:28.240283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.249299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:28.509517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc841-4062-43d5-8c8f-41af20e59575 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.522008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 833/1703] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:28.526040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.527167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.527870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.529895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] PATH_INFO: `/v3/projects/934251b859d143b394faf2e4ee44d8a1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.532066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934251b859d143b394faf2e4ee44d8a1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.533284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319bbfb-49e2-4096-bba6-0e37de97a61e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.533730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319bbfb-49e2-4096-bba6-0e37de97a61e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.534021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319bbfb-49e2-4096-bba6-0e37de97a61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.537250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.589178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d319bbfb-49e2-4096-bba6-0e37de97a61e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:28.595506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d319bbfb-49e2-4096-bba6-0e37de97a61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:28.613313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 834/1704] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:28.617706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319bbfb-49e2-4096-bba6-0e37de97a61e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.634465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319bbfb-49e2-4096-bba6-0e37de97a61e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.642253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.643774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.644087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.644371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.645073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:28.646105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.647847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.691603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 835/1705] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:28.691603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.697947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:28.751462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934251b859d143b394faf2e4ee44d8a1', 'request_id': 'req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:28.774145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f848-320d-4a85-8ff0-c5360d6c7b95 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.774246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934251b859d143b394faf2e4ee44d8a1', 'request_id': 'req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:28.904072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934251b859d143b394faf2e4ee44d8a1', 'request_id': 'req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:28.931214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] The token cache is being invalidate because project 934251b859d143b394faf2e4ee44d8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:28.931802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:28.933630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:28.938500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 871/1706] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:28 2022] DELETE /identity/v3/projects/934251b859d143b394faf2e4ee44d8a1 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:28.940478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.944155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.104293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.109325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.111922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.114744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] PATH_INFO: `/v3/projects/5ee573df90244e76a7ff255a0d8d88ef` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.121089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee573df90244e76a7ff255a0d8d88ef)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.132402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.167978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3773-fc98-4e9b-bec3-2e90ef6137a3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.185471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13284e1-48ad-4f7a-a9dc-6944ec38aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.187275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13284e1-48ad-4f7a-a9dc-6944ec38aa43 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.187785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13284e1-48ad-4f7a-a9dc-6944ec38aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.188373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13284e1-48ad-4f7a-a9dc-6944ec38aa43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.189756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13284e1-48ad-4f7a-a9dc-6944ec38aa43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.195088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13284e1-48ad-4f7a-a9dc-6944ec38aa43 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.339462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:29.349504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee573df90244e76a7ff255a0d8d88ef', 'request_id': 'req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:29.368739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 872/1707] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:28 2022] POST /identity/v3/projects => generated 393 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:29.370700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee573df90244e76a7ff255a0d8d88ef', 'request_id': 'req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:29.375313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.378161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.378161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.459544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] MFA Rules not processed for user `8cacffb3524f4f8ea97946e5e4af1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:29.462303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.534786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee573df90244e76a7ff255a0d8d88ef', 'request_id': 'req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:29.667168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] The token cache is being invalidate because project 5ee573df90244e76a7ff255a0d8d88ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:29.667600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:29.683422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 873/1708] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:29.690411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:29.693451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 836/1709] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:28 2022] DELETE /identity/v3/projects/5ee573df90244e76a7ff255a0d8d88ef => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:29.694843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.697281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.702943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.710847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.867930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f780-73f6-4d4b-9b9d-dcb29ecc6335 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.875236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8c4dc-f7f2-4e9c-91d5-a2623d1c73f5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.875683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512a2ea-5ff2-4186-b5f8-8df237bf9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.876488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a2ea-5ff2-4186-b5f8-8df237bf9d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.876866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a2ea-5ff2-4186-b5f8-8df237bf9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.877362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a2ea-5ff2-4186-b5f8-8df237bf9d65 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.878123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512a2ea-5ff2-4186-b5f8-8df237bf9d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.881241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512a2ea-5ff2-4186-b5f8-8df237bf9d65 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.885194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.886680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.887201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.888672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] PATH_INFO: `/v3/users/96732e4a7a7d49f6a9b9cfd8a93445f2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.891448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96732e4a7a7d49f6a9b9cfd8a93445f2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.899824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.057559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 837/1710] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:29 2022] POST /identity/v3/users => generated 297 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:30.061304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8f64f-b78d-4027-8d6d-1014dac5b920 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.061867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8f64f-b78d-4027-8d6d-1014dac5b920 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.064297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8f64f-b78d-4027-8d6d-1014dac5b920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.134071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3de8f64f-b78d-4027-8d6d-1014dac5b920 None None] MFA Rules not processed for user `8cacffb3524f4f8ea97946e5e4af1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:30.141720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3de8f64f-b78d-4027-8d6d-1014dac5b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:30.171592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 838/1711] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:30.181845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8e8c0-1f00-40cf-a5a3-9f84d503af18 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.182340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8e8c0-1f00-40cf-a5a3-9f84d503af18 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.183286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8e8c0-1f00-40cf-a5a3-9f84d503af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.213063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-00f8e8c0-1f00-40cf-a5a3-9f84d503af18 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:30.215192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-00f8e8c0-1f00-40cf-a5a3-9f84d503af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:30.233642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 839/1712] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:30.233642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8e8c0-1f00-40cf-a5a3-9f84d503af18 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.249632 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8e8c0-1f00-40cf-a5a3-9f84d503af18 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.257748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.258819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.259324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.259819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.260995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.264457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.279265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 840/1713] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:30.303513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.306359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96732e4a7a7d49f6a9b9cfd8a93445f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:30.310782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:30.327763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96732e4a7a7d49f6a9b9cfd8a93445f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:30.336989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96732e4a7a7d49f6a9b9cfd8a93445f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:30.337862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96732e4a7a7d49f6a9b9cfd8a93445f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:30.437786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec78cff-85d0-448d-b35b-f93467ee7886 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.445260 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.445925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.446216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.446495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.448692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:30.487002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.491308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.505986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f50bbb2f-fe85-4e46-946b-c210134807b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96732e4a7a7d49f6a9b9cfd8a93445f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:30.516483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 874/1714] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:29 2022] DELETE /identity/v3/users/96732e4a7a7d49f6a9b9cfd8a93445f2 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:30.531685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39bc9-5011-4efb-92f0-f1fc42f88c28 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.532018 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39bc9-5011-4efb-92f0-f1fc42f88c28 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.532262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39bc9-5011-4efb-92f0-f1fc42f88c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.534564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 841/1715] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:30.537427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.570770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2163d3-44d0-484f-9009-41bf19f487a4 service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.655345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8fa39bc9-5011-4efb-92f0-f1fc42f88c28 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:30.661003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8fa39bc9-5011-4efb-92f0-f1fc42f88c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:30.847441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 875/1716] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:30.855883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39bc9-5011-4efb-92f0-f1fc42f88c28 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.878006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39bc9-5011-4efb-92f0-f1fc42f88c28 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.885092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.885092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.885092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.885542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.885918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:30.886373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.888436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.898152 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.902212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.902794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.903414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.908452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.908934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 876/1717] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:21:30.909650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.919853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.922409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323edfa-4546-48bf-a4e6-23405a7e6346 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.929323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.929988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.930884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.930884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.931445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.933992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.979602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 842/1718] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:30.982003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.988348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:31.031653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e604181-75b5-4904-bec0-792157cfca2a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.048780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cf53f-c248-4023-be4c-9069b257cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.049957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf53f-c248-4023-be4c-9069b257cfeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.050291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf53f-c248-4023-be4c-9069b257cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.054869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf53f-c248-4023-be4c-9069b257cfeb admin admin] PATH_INFO: `/v3/projects/ef0bb58648ee4f21a05222887ed8c724/users/6cae26649e014461843a277b2d6967f0/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.074213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 877/1719] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:30 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:31.075387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.081195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cf53f-c248-4023-be4c-9069b257cfeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0bb58648ee4f21a05222887ed8c724, user_id=6cae26649e014461843a277b2d6967f0, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.087435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cf53f-c248-4023-be4c-9069b257cfeb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.186366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 843/1720] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:30 2022] PUT /identity/v3/projects/ef0bb58648ee4f21a05222887ed8c724/users/6cae26649e014461843a277b2d6967f0/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:31.210332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94772-319d-445b-b101-ed9410132e1e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.210688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94772-319d-445b-b101-ed9410132e1e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.210929 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94772-319d-445b-b101-ed9410132e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.223897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5858502-cc4a-49ac-a07c-5e96b3401da7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.314570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-cdf94772-319d-445b-b101-ed9410132e1e None None] MFA Rules not processed for user `6cae26649e014461843a277b2d6967f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:31.316553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-cdf94772-319d-445b-b101-ed9410132e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:31.394874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.395634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.396005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.396364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.397455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.399776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.578582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 844/1721] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:31.591486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf94772-319d-445b-b101-ed9410132e1e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.618276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 878/1722] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:31 2022] POST /identity/v3/users => generated 283 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:31.625914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.635864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:31.640979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf94772-319d-445b-b101-ed9410132e1e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.661206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3d687-a140-4df2-8637-b1c4963cd725 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.683472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.689431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.690409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.690936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.692315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.697789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.698404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.698606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.699607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] PATH_INFO: `/v3/projects/d2a559abbb714f5eb9917449da74ae7c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.704631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a559abbb714f5eb9917449da74ae7c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.707740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.709952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.725360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:31.975595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 845/1723] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:31 2022] POST /identity/v3/projects => generated 393 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:31.982374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.989791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a559abbb714f5eb9917449da74ae7c', 'request_id': 'req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:32.014375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a559abbb714f5eb9917449da74ae7c', 'request_id': 'req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:32.155970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a559abbb714f5eb9917449da74ae7c', 'request_id': 'req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:32.192479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] The token cache is being invalidate because project d2a559abbb714f5eb9917449da74ae7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:32.193236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:32.196180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:32.200042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 879/1724] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:31 2022] DELETE /identity/v3/projects/d2a559abbb714f5eb9917449da74ae7c => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:32.200819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:32.206605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:32.286059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41903-13c5-431c-bf83-17ef443f838e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:32.303978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c117421-8e40-492a-ad02-6e56c9c3df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:32.305945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117421-8e40-492a-ad02-6e56c9c3df6b admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.306301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117421-8e40-492a-ad02-6e56c9c3df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.307247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117421-8e40-492a-ad02-6e56c9c3df6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.308844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c117421-8e40-492a-ad02-6e56c9c3df6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:32.315171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c117421-8e40-492a-ad02-6e56c9c3df6b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:32.374986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 846/1725] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:32.376595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.376883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.377451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.455797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:32.457080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:32.483106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0fc27-2841-47ac-a771-1b77e41bcf9e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:32.495780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 847/1726] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:32.500375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:32.512037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:32.513383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.513783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.514045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:32.514518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.515416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:32.517909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:32.560189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d086ca-d5da-428d-a64a-b05a64c81080 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:32.584520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f01951-b105-471c-8ea3-98c243add731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:32.585160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01951-b105-471c-8ea3-98c243add731 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.585358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01951-b105-471c-8ea3-98c243add731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.585644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01951-b105-471c-8ea3-98c243add731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.586323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f01951-b105-471c-8ea3-98c243add731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:32.588619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f01951-b105-471c-8ea3-98c243add731 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:32.619139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 848/1727] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:32.623515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ed443-cd85-4eca-9eb0-00c8e3a402e9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.623988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ed443-cd85-4eca-9eb0-00c8e3a402e9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.624277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ed443-cd85-4eca-9eb0-00c8e3a402e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.695604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d17ed443-cd85-4eca-9eb0-00c8e3a402e9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:32.701453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d17ed443-cd85-4eca-9eb0-00c8e3a402e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:32.721359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:32.740752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 880/1728] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:32 2022] POST /identity/v3/users => generated 303 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:32.743775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:32.763546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 849/1729] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:32.765481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ed443-cd85-4eca-9eb0-00c8e3a402e9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:32.816249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b6b1-91db-4bd1-86be-f4cd0f790fdc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:32.842563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:32.843715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.845534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.848745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] PATH_INFO: `/v3/projects/3236943fddfb4a41889dc52e98a874a6/users/aca52c8e7e484ddf8b7d8dd097958787/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.863229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ed443-cd85-4eca-9eb0-00c8e3a402e9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:32.909182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:32.916652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.916652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.919268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.920628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:32.923890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:32.992059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3236943fddfb4a41889dc52e98a874a6, user_id=aca52c8e7e484ddf8b7d8dd097958787, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.004008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.042522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 850/1730] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:33.043093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.081939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440b2a-6f9c-470a-9ff4-4afca12ecc45 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.088003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447e364-b881-4b76-9081-1da3a21215f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.088599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e364-b881-4b76-9081-1da3a21215f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.088883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e364-b881-4b76-9081-1da3a21215f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.089160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e364-b881-4b76-9081-1da3a21215f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.089934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447e364-b881-4b76-9081-1da3a21215f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:33.090751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447e364-b881-4b76-9081-1da3a21215f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.093035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447e364-b881-4b76-9081-1da3a21215f0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.135446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 851/1731] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:33.137126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e8d7-a6d2-4909-8dc9-2483284485c6 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.137478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e8d7-a6d2-4909-8dc9-2483284485c6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.137763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e8d7-a6d2-4909-8dc9-2483284485c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.201122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bfa6e8d7-a6d2-4909-8dc9-2483284485c6 None None] MFA Rules not processed for user `8cacffb3524f4f8ea97946e5e4af1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:33.202564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bfa6e8d7-a6d2-4909-8dc9-2483284485c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:33.225857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 881/1732] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:32 2022] PUT /identity/v3/projects/3236943fddfb4a41889dc52e98a874a6/users/aca52c8e7e484ddf8b7d8dd097958787/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:33.227349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.368756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445216-da41-4be2-a5d1-10afaea9804f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.386470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49983ca1-410a-4fd3-bc12-172cdd0e238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.387404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 852/1733] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:33.388215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49983ca1-410a-4fd3-bc12-172cdd0e238d admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.388358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e8d7-a6d2-4909-8dc9-2483284485c6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.388715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49983ca1-410a-4fd3-bc12-172cdd0e238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.389118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49983ca1-410a-4fd3-bc12-172cdd0e238d admin admin] PATH_INFO: `/v3/projects/523ef39f270444e484455190a436df61/users/8b75bece6edb4b448059cee1c2a3d264/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.438557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e8d7-a6d2-4909-8dc9-2483284485c6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.455117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.456105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.457041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49983ca1-410a-4fd3-bc12-172cdd0e238d admin admin] RBAC: Authorizing `identity:create_grant(project_id=523ef39f270444e484455190a436df61, user_id=8b75bece6edb4b448059cee1c2a3d264, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.459357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.459921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.461945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.470577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.474662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49983ca1-410a-4fd3-bc12-172cdd0e238d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.683018 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 882/1734] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:33 2022] PUT /identity/v3/projects/523ef39f270444e484455190a436df61/users/8b75bece6edb4b448059cee1c2a3d264/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:33.698084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8251e-4021-4e85-9f7b-fed00feb9f37 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.698084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8251e-4021-4e85-9f7b-fed00feb9f37 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.698084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8251e-4021-4e85-9f7b-fed00feb9f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.708603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 853/1735] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:33 2022] POST /identity/v3/projects => generated 379 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:33.708603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.775705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-94d8251e-4021-4e85-9f7b-fed00feb9f37 None None] MFA Rules not processed for user `aca52c8e7e484ddf8b7d8dd097958787`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:33.777756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-94d8251e-4021-4e85-9f7b-fed00feb9f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:33.929559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6f02a-55c9-4627-ae6f-3af12606ede2 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.930025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 883/1736] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:33.931633 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8251e-4021-4e85-9f7b-fed00feb9f37 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.938883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.941435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.944269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.944269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.944269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.948337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.950667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8251e-4021-4e85-9f7b-fed00feb9f37 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.957802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.958878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.959419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.959846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.960729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.963799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.981962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 854/1737] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:33.987924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.010597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a9ff-f3f4-4a93-923c-00c4cd8def99 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.019378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3392b-5583-46ac-854e-d3fcc1f7282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:34.020331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3392b-5583-46ac-854e-d3fcc1f7282e admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.020757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3392b-5583-46ac-854e-d3fcc1f7282e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.021235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3392b-5583-46ac-854e-d3fcc1f7282e admin admin] PATH_INFO: `/v3/projects/523ef39f270444e484455190a436df61/users/8b75bece6edb4b448059cee1c2a3d264/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.024187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3392b-5583-46ac-854e-d3fcc1f7282e admin admin] RBAC: Authorizing `identity:create_grant(project_id=523ef39f270444e484455190a436df61, user_id=8b75bece6edb4b448059cee1c2a3d264, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:34.039494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3392b-5583-46ac-854e-d3fcc1f7282e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:34.082889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 855/1738] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:33 2022] PUT /identity/v3/projects/523ef39f270444e484455190a436df61/users/8b75bece6edb4b448059cee1c2a3d264/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:34.101964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11d20-fcb0-4960-8616-999d96119806 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.102328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11d20-fcb0-4960-8616-999d96119806 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.102651 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11d20-fcb0-4960-8616-999d96119806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.110180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 884/1739] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:33 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:34.111518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.134813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3adc-cde3-403b-8fb7-be975023fcb1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.163491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:34.187031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-64d11d20-fcb0-4960-8616-999d96119806 None None] MFA Rules not processed for user `8b75bece6edb4b448059cee1c2a3d264`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:34.188479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-64d11d20-fcb0-4960-8616-999d96119806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:34.378850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 856/1740] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:34.394500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:34.395548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.396066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.396568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.397528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:34.407272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:34.460245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 885/1741] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:34.461804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11d20-fcb0-4960-8616-999d96119806 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.486086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11d20-fcb0-4960-8616-999d96119806 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.503520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:34.505934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.506229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.506519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.512916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:34.513941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:34.545142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 857/1742] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:34.550837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.568844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7199-3bcb-4203-90a9-fb1afb1a6957 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.580547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:34.582478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.583048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.583195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] PATH_INFO: `/v3/projects/804d5fbc865d4658a0b59716203e88b7/users/ef117bc972694c8e86304882030dc8d9/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.621040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.623444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:34.641741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] RBAC: Authorizing `identity:create_grant(project_id=804d5fbc865d4658a0b59716203e88b7, user_id=ef117bc972694c8e86304882030dc8d9, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:34.645166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:34.797253 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 886/1743] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:34 2022] PUT /identity/v3/projects/804d5fbc865d4658a0b59716203e88b7/users/ef117bc972694c8e86304882030dc8d9/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:34.798255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.806435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:34.832109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22d981-0352-4346-8a69-c9a82610b76c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.988319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d2db-bffc-4d37-8678-f6443cf1bdda admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:35.001368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63bda8-2b32-4a1e-831f-049af58c802f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:35.006214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63bda8-2b32-4a1e-831f-049af58c802f service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:35.006214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63bda8-2b32-4a1e-831f-049af58c802f service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:35.006214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63bda8-2b32-4a1e-831f-049af58c802f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:35.058752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa60c6c-02ed-4626-819f-f63231d859cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:35.059878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60c6c-02ed-4626-819f-f63231d859cc service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:35.063176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60c6c-02ed-4626-819f-f63231d859cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:35.063794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60c6c-02ed-4626-819f-f63231d859cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:35.108294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63bda8-2b32-4a1e-831f-049af58c802f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:35.109777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63bda8-2b32-4a1e-831f-049af58c802f service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:35.128274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 887/1744] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:35.131277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c9a04-f883-46a5-a98f-1e8c19a9fee0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:35.131571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c9a04-f883-46a5-a98f-1e8c19a9fee0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:35.131924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c9a04-f883-46a5-a98f-1e8c19a9fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:35.169188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-734c9a04-f883-46a5-a98f-1e8c19a9fee0 None None] MFA Rules not processed for user `ef117bc972694c8e86304882030dc8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:35.170460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-734c9a04-f883-46a5-a98f-1e8c19a9fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:35.214507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa60c6c-02ed-4626-819f-f63231d859cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:35.218537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa60c6c-02ed-4626-819f-f63231d859cc service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:35.239057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 858/1745] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:35.239057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00166-7162-4bf7-9c9a-d704de8986d8 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:35.239057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00166-7162-4bf7-9c9a-d704de8986d8 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:35.239057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00166-7162-4bf7-9c9a-d704de8986d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:35.316207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 888/1746] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:35.327037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c9a04-f883-46a5-a98f-1e8c19a9fee0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:35.327539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ebd00166-7162-4bf7-9c9a-d704de8986d8 None None] MFA Rules not processed for user `acd37d5161b247139f337ef0bf50a764`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:35.328968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ebd00166-7162-4bf7-9c9a-d704de8986d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:35.514096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 859/1747] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:35.627287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c9a04-f883-46a5-a98f-1e8c19a9fee0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:35.641519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:35.642330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:35.642616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:35.642935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:35.643627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:35.645753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:35.830587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 889/1748] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:35 2022] POST /identity/v3/projects => generated 373 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:35.834128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd00166-7162-4bf7-9c9a-d704de8986d8 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:35.839741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:35.856060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:35.858716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd00166-7162-4bf7-9c9a-d704de8986d8 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:36.121898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282202d-d738-4cc5-b57a-f5d82c7f9a4c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:36.133507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44aa80-fa27-47cc-a1a6-1066a8aebdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:36.136197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44aa80-fa27-47cc-a1a6-1066a8aebdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.137461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44aa80-fa27-47cc-a1a6-1066a8aebdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.138353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44aa80-fa27-47cc-a1a6-1066a8aebdd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:36.140491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44aa80-fa27-47cc-a1a6-1066a8aebdd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:36.149789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44aa80-fa27-47cc-a1a6-1066a8aebdd2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:36.175886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:36.181967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.187550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.188057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:36.200002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:36.300587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:36.303119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:36.316724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 890/1749] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:35 2022] POST /identity/v3/users => generated 293 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:21:36.318238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 860/1750] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:36.321205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279909-d352-4884-bc48-342e156730f1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.323088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279909-d352-4884-bc48-342e156730f1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.324444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279909-d352-4884-bc48-342e156730f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:36.334962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:36.363976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b76c-e1b8-4e3b-8447-c67aa0b8302c service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:36.380711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:36.381610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.382083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.382514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:36.383689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:36.385516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:36.408059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 861/1751] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:36.414066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:36.454146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3edd56-8970-4340-b070-e3b50c9d48c3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:36.486980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:36.487701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.487991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.488278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] PATH_INFO: `/v3/projects/4d695f90411f4d6e8a44cfb0f45a00d7/users/a1aafe9738814f5f80c042b4a48c0c4a/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:36.525338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-58279909-d352-4884-bc48-342e156730f1 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:36.527111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-58279909-d352-4884-bc48-342e156730f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:36.531096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d695f90411f4d6e8a44cfb0f45a00d7, user_id=a1aafe9738814f5f80c042b4a48c0c4a, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:36.534927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:36.650118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 891/1752] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:36.731543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 862/1753] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:36 2022] PUT /identity/v3/projects/4d695f90411f4d6e8a44cfb0f45a00d7/users/a1aafe9738814f5f80c042b4a48c0c4a/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:36.735633 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279909-d352-4884-bc48-342e156730f1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:36.757671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279909-d352-4884-bc48-342e156730f1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:36.927468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdbc83-e80b-4ebf-a43c-39d5b0e0974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:36.928110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdbc83-e80b-4ebf-a43c-39d5b0e0974b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.928775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdbc83-e80b-4ebf-a43c-39d5b0e0974b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.929219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdbc83-e80b-4ebf-a43c-39d5b0e0974b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:36.932117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdbc83-e80b-4ebf-a43c-39d5b0e0974b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:36.934483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdbc83-e80b-4ebf-a43c-39d5b0e0974b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:36.949004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 892/1754] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:21:36.954148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:36.966200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5e87b-3274-45a1-9e5a-a74241764d60 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:36.971809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:36.972754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.973303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.973602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] PATH_INFO: `/v3/projects/4d695f90411f4d6e8a44cfb0f45a00d7/users/a1aafe9738814f5f80c042b4a48c0c4a/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:36.975888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d695f90411f4d6e8a44cfb0f45a00d7, user_id=a1aafe9738814f5f80c042b4a48c0c4a, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:36.979482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:36.993990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 863/1755] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:36 2022] PUT /identity/v3/projects/4d695f90411f4d6e8a44cfb0f45a00d7/users/a1aafe9738814f5f80c042b4a48c0c4a/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:37.004969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39195-6f9f-44d6-b886-62185881694f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:37.005258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39195-6f9f-44d6-b886-62185881694f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:37.005728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39195-6f9f-44d6-b886-62185881694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:37.131779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-adf39195-6f9f-44d6-b886-62185881694f None None] MFA Rules not processed for user `a1aafe9738814f5f80c042b4a48c0c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:37.133096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-adf39195-6f9f-44d6-b886-62185881694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:37.267561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:37.269836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:37.364104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 893/1756] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:37.613039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4696a3-148c-402a-ac86-168dfe05d812 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:37.625046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f363240-c9f0-44a6-85df-902380070dcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:37.627818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f363240-c9f0-44a6-85df-902380070dcc service swift] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:37.628225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f363240-c9f0-44a6-85df-902380070dcc service swift] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:37.629397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f363240-c9f0-44a6-85df-902380070dcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:37.752858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39195-6f9f-44d6-b886-62185881694f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:37.812564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f363240-c9f0-44a6-85df-902380070dcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:37.818783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f363240-c9f0-44a6-85df-902380070dcc service swift] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:37.864420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 864/1757] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:21:38.004740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39195-6f9f-44d6-b886-62185881694f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:38.015841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:38.064319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:38.064809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:38.065319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:38.070953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:38.134666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:38.136172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:38.204262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 894/1758] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:39.558559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:41.135060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f673d-818c-4810-84a9-5a88810920f3 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:41.135677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f673d-818c-4810-84a9-5a88810920f3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:41.136564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f673d-818c-4810-84a9-5a88810920f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:41.218363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-892f673d-818c-4810-84a9-5a88810920f3 None None] MFA Rules not processed for user `765ee8241c4e448eb999016b17132e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:41.230052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-892f673d-818c-4810-84a9-5a88810920f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:41.407997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 865/1759] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Aug 17 20:21:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:41.488700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:41.495452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:41.501859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:41.572671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33507ce-ce4a-4c88-8755-c20e7ec50e4b service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:41.591038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:41.591820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:41.592111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:41.592397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:41.618377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:41.634680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:41.659527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 895/1760] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:42.583931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f673d-818c-4810-84a9-5a88810920f3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:42.609846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f673d-818c-4810-84a9-5a88810920f3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:42.627477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1aafe9738814f5f80c042b4a48c0c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d695f90411f4d6e8a44cfb0f45a00d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:42.628277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.628571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.628857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.629856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:42.630175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:42.632030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:42.702566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 866/1761] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:42.706523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:42.773588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12399af3-ab1f-49bc-9513-9eeaab0a4aeb service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:42.790417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1aafe9738814f5f80c042b4a48c0c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d695f90411f4d6e8a44cfb0f45a00d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:42.793190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.793937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.794481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.796125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:42.802770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:43.053737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 896/1762] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:42 2022] POST /identity/v3/projects => generated 354 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:43.058856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:43.083541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bf52b-b7ab-4bd0-804e-792d5ee7a20b tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:43.382328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19d9a-6fd4-4c52-a3c4-365daf283290 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1aafe9738814f5f80c042b4a48c0c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d695f90411f4d6e8a44cfb0f45a00d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:43.386843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19d9a-6fd4-4c52-a3c4-365daf283290 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.387800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19d9a-6fd4-4c52-a3c4-365daf283290 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.388574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19d9a-6fd4-4c52-a3c4-365daf283290 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.391607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19d9a-6fd4-4c52-a3c4-365daf283290 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:43.392616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19d9a-6fd4-4c52-a3c4-365daf283290 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:43.397103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19d9a-6fd4-4c52-a3c4-365daf283290 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:43.464169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 867/1763] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:43.697740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:43.723265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dc44d-14f7-4ef1-b520-27e50c9dfcd4 tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:43.771555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1aafe9738814f5f80c042b4a48c0c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d695f90411f4d6e8a44cfb0f45a00d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:43.771717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.778652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.779287 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] PATH_INFO: `/v3/projects/c15ab00abc974c3d80590f108451e383` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.790492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c15ab00abc974c3d80590f108451e383)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:43.795122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:44.053694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15ab00abc974c3d80590f108451e383', 'request_id': 'req-47e34c04-6a9f-4bf4-94b1-850d071957ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:44.066264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15ab00abc974c3d80590f108451e383', 'request_id': 'req-47e34c04-6a9f-4bf4-94b1-850d071957ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:44.185047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15ab00abc974c3d80590f108451e383', 'request_id': 'req-47e34c04-6a9f-4bf4-94b1-850d071957ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:44.258567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] The token cache is being invalidate because project c15ab00abc974c3d80590f108451e383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:44.261085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:44.261085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47e34c04-6a9f-4bf4-94b1-850d071957ee tempest-VolumeQuotaClassesTest-602188 tempest-VolumeQuotaClassesTest-602188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:44.270580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 897/1764] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:43 2022] DELETE /identity/v3/projects/c15ab00abc974c3d80590f108451e383 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:44.905789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7e25-5d92-4170-b6f2-4045ad07571a None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:44.908455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7e25-5d92-4170-b6f2-4045ad07571a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:44.910521 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7e25-5d92-4170-b6f2-4045ad07571a None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:44.920115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 868/1765] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:21:44 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:45.260239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:45.340225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:45.381552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f6c15-4f27-4d66-ba3d-1fde8d30add7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.394951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f6c15-4f27-4d66-ba3d-1fde8d30add7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.395894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f6c15-4f27-4d66-ba3d-1fde8d30add7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.568750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a59f6c15-4f27-4d66-ba3d-1fde8d30add7 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:45.571438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a59f6c15-4f27-4d66-ba3d-1fde8d30add7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:45.874976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 898/1766] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:21:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:46.286739 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae7e25-5d92-4170-b6f2-4045ad07571a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:46.293448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3aae7e25-5d92-4170-b6f2-4045ad07571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:46.484557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251695-91f2-41e8-a56a-3bf0ca9fdd75 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.485360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251695-91f2-41e8-a56a-3bf0ca9fdd75 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.485360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251695-91f2-41e8-a56a-3bf0ca9fdd75 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.487272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 899/1767] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:46.526763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae7e25-5d92-4170-b6f2-4045ad07571a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:46.572814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:46.575821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.575821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.575821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] PATH_INFO: `/v3/users/ef117bc972694c8e86304882030dc8d9` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.581625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef117bc972694c8e86304882030dc8d9)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:46.588953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:46.620143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ea04-dccb-4501-896d-f4b5a0a6f032 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.623711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ea04-dccb-4501-896d-f4b5a0a6f032 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.624327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ea04-dccb-4501-896d-f4b5a0a6f032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.773742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-04d9ea04-dccb-4501-896d-f4b5a0a6f032 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:46.788187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04d9ea04-dccb-4501-896d-f4b5a0a6f032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:46.889557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 900/1768] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:21:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:46.891308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef117bc972694c8e86304882030dc8d9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:46.933375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef117bc972694c8e86304882030dc8d9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:46.936468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef117bc972694c8e86304882030dc8d9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:47.080860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef117bc972694c8e86304882030dc8d9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:47.081926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef117bc972694c8e86304882030dc8d9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:47.106720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 869/1769] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:46 2022] DELETE /identity/v3/users/ef117bc972694c8e86304882030dc8d9 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:47.113158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:47.113652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:47.114750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:47.177353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:47.180390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:47.341449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:47.347168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:47.433288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 901/1770] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:47.441711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:47.444467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:47.578071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135325-2cbe-46a2-b5b2-3421a29b5237 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:47.615100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:47.616338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:47.616782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:47.617254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:47.622873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:47.668915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:47.680405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:47.735055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:47.749299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 870/1771] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:47.762320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:47.766918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:47.870000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f27e6-a9f3-4b0a-b8ce-f2e8bbe4b5e1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:47.894708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:47.894708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:47.899283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:47.899718 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:47.902037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:47.959210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:47.959210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:47.991622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 902/1772] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:47.995683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b324b5-8ac5-40f4-a386-cdfd5f9c2f65 service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:48.005019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188404-a70c-48ba-9696-9e86111901cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:48.005650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188404-a70c-48ba-9696-9e86111901cb service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.005936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188404-a70c-48ba-9696-9e86111901cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.006214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188404-a70c-48ba-9696-9e86111901cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.017592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188404-a70c-48ba-9696-9e86111901cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:48.019366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188404-a70c-48ba-9696-9e86111901cb service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:48.033767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 871/1773] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:48.764132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:48.765726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:48.822773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eac559-9410-4b0b-8bbb-b68de798c135 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:48.860304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:48.860304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.863655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.864563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] PATH_INFO: `/v3/users/6cae26649e014461843a277b2d6967f0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.874261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cae26649e014461843a277b2d6967f0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:48.916308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:49.254781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:49.388706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:49.397868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cae26649e014461843a277b2d6967f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:49.484712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cae26649e014461843a277b2d6967f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:49.508086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cae26649e014461843a277b2d6967f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:49.511340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cae26649e014461843a277b2d6967f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:49.612698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cae26649e014461843a277b2d6967f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:49.632494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 903/1774] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:48 2022] DELETE /identity/v3/users/6cae26649e014461843a277b2d6967f0 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:49.634419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:49.635071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:49.635071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:49.704269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:49.706436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:49.924907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 872/1775] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:50.001648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:50.004307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:50.171282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeb5d5-fd1d-4276-9182-ef42cf9ce2e7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:50.182765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:50.183705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:50.184154 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:50.184720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:50.218616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:50.222410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:50.253597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 904/1776] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:51.143346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:51.146089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:51.187582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e1520-3a18-4634-b4ef-36f7fda09cd2 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:51.220046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:51.221099 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:51.228175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:51.241975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] PATH_INFO: `/v3/projects/804d5fbc865d4658a0b59716203e88b7` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:51.245751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804d5fbc865d4658a0b59716203e88b7)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:51.254890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:51.613145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804d5fbc865d4658a0b59716203e88b7', 'request_id': 'req-8992898d-025d-460c-9ddc-16bd4af0f051'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:51.639602 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804d5fbc865d4658a0b59716203e88b7', 'request_id': 'req-8992898d-025d-460c-9ddc-16bd4af0f051'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:51.780791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804d5fbc865d4658a0b59716203e88b7', 'request_id': 'req-8992898d-025d-460c-9ddc-16bd4af0f051'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:51.838303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] The token cache is being invalidate because project 804d5fbc865d4658a0b59716203e88b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:51.839121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:51.843822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:51.854399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 873/1777] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:51 2022] DELETE /identity/v3/projects/804d5fbc865d4658a0b59716203e88b7 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:51.860269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:51.901590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88669d-59dd-4395-ab7c-717cd706cabc service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:52.065296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:52.066962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:52.067877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:52.068763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] PATH_INFO: `/v3/users/a1aafe9738814f5f80c042b4a48c0c4a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:52.072300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1aafe9738814f5f80c042b4a48c0c4a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:52.076934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:52.109475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:52.394519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:52.401547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:52.460976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1aafe9738814f5f80c042b4a48c0c4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:52.471998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992898d-025d-460c-9ddc-16bd4af0f051 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:52.483424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:52.484962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:52.485617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:52.486422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] PATH_INFO: `/v3/projects/ef0bb58648ee4f21a05222887ed8c724` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:52.490283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0bb58648ee4f21a05222887ed8c724)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:52.497350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:52.594184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1aafe9738814f5f80c042b4a48c0c4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:52.617195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1aafe9738814f5f80c042b4a48c0c4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:52.619143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1aafe9738814f5f80c042b4a48c0c4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:52.776791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0bb58648ee4f21a05222887ed8c724', 'request_id': 'req-ac7606e3-36c2-42a3-9493-8c9164b81d8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:52.784290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1aafe9738814f5f80c042b4a48c0c4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:52.802487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 905/1778] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:51 2022] DELETE /identity/v3/users/a1aafe9738814f5f80c042b4a48c0c4a => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:52.819295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0bb58648ee4f21a05222887ed8c724', 'request_id': 'req-ac7606e3-36c2-42a3-9493-8c9164b81d8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:52.975317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0bb58648ee4f21a05222887ed8c724', 'request_id': 'req-ac7606e3-36c2-42a3-9493-8c9164b81d8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.002035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] The token cache is being invalidate because project ef0bb58648ee4f21a05222887ed8c724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:53.003774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.005092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.010253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 874/1779] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:52 2022] DELETE /identity/v3/projects/ef0bb58648ee4f21a05222887ed8c724 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:53.019244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:53.023356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.188465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf99c-2d58-47ef-98bd-90f0819b009c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:53.194929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:53.195700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.195890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.196182 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] PATH_INFO: `/v3/users/8b75bece6edb4b448059cee1c2a3d264` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.197947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b75bece6edb4b448059cee1c2a3d264)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:53.201090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:53.517005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b75bece6edb4b448059cee1c2a3d264'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.536547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b75bece6edb4b448059cee1c2a3d264'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.551148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b75bece6edb4b448059cee1c2a3d264'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.552624 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b75bece6edb4b448059cee1c2a3d264'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.670449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b75bece6edb4b448059cee1c2a3d264'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.688086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 906/1780] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:53 2022] DELETE /identity/v3/users/8b75bece6edb4b448059cee1c2a3d264 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:53.722113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:53.724572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.848884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7606e3-36c2-42a3-9493-8c9164b81d8b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:53.850071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:53.851559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.959103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b7698-b933-49a7-9f41-81ea69b22b41 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:53.973097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:53.977267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.977267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.977267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] PATH_INFO: `/v3/projects/4d695f90411f4d6e8a44cfb0f45a00d7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.979726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d695f90411f4d6e8a44cfb0f45a00d7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:53.984758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:54.087360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:54.088314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.089002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.089453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] PATH_INFO: `/v3/users/973003011682498e88398abaedea730a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.092613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973003011682498e88398abaedea730a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:54.095482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:54.370506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d695f90411f4d6e8a44cfb0f45a00d7', 'request_id': 'req-eec37399-25bb-47c9-a299-96de3fc73ddd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.379548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d695f90411f4d6e8a44cfb0f45a00d7', 'request_id': 'req-eec37399-25bb-47c9-a299-96de3fc73ddd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.464919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973003011682498e88398abaedea730a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.481902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d695f90411f4d6e8a44cfb0f45a00d7', 'request_id': 'req-eec37399-25bb-47c9-a299-96de3fc73ddd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.490314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973003011682498e88398abaedea730a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.491545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973003011682498e88398abaedea730a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.505010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] The token cache is being invalidate because project 4d695f90411f4d6e8a44cfb0f45a00d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:54.505510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.506717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eec37399-25bb-47c9-a299-96de3fc73ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.509441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 907/1781] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:53 2022] DELETE /identity/v3/projects/4d695f90411f4d6e8a44cfb0f45a00d7 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:54.518573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45d4e-d7e4-4e02-9885-6691067dc8f0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.519112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45d4e-d7e4-4e02-9885-6691067dc8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.519611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45d4e-d7e4-4e02-9885-6691067dc8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.551404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-68f45d4e-d7e4-4e02-9885-6691067dc8f0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:54.552803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-68f45d4e-d7e4-4e02-9885-6691067dc8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:54.624558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973003011682498e88398abaedea730a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.625185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973003011682498e88398abaedea730a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.627520 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:54.644576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 875/1782] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:53 2022] DELETE /identity/v3/users/973003011682498e88398abaedea730a => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:54.645894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:54.648355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:54.650681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 908/1783] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:54.653514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025d158-f771-495d-a54b-7f30845cbafc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.654029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025d158-f771-495d-a54b-7f30845cbafc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.654522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025d158-f771-495d-a54b-7f30845cbafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.683022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0025d158-f771-495d-a54b-7f30845cbafc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:54.685506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0025d158-f771-495d-a54b-7f30845cbafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:54.751675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf887-fdae-4c4c-80ac-a75387329de7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:54.760357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:54.760915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 909/1784] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:54.761339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.762417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.763079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] PATH_INFO: `/v3/projects/523ef39f270444e484455190a436df61` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.763236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.763525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.767226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.767484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523ef39f270444e484455190a436df61)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:54.769081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:54.787091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:54.788380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:54.799326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 910/1785] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:54.800909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:54.803247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:54.879221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf6c03-46d8-4456-a09d-cbafb84ecb54 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:54.883875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:54.884704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.885090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.885459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.897502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:54.899005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:54.910502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 911/1786] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:54.911417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:54.922787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751746-a553-4228-b326-25eb9045a868 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:54.927983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:54.928617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.928897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.929174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.929839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:54.930136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:54.931924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:54.951703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 912/1787] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:54.958216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:54.968859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523ef39f270444e484455190a436df61', 'request_id': 'req-3e5c1798-8ed2-4c33-bf49-de51c69459d7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:54.979968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db645-e56e-43a8-bca5-88e6e66fd675 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:54.980274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523ef39f270444e484455190a436df61', 'request_id': 'req-3e5c1798-8ed2-4c33-bf49-de51c69459d7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:55.079496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.081694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.081694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.081694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.081942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.084231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.109986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523ef39f270444e484455190a436df61', 'request_id': 'req-3e5c1798-8ed2-4c33-bf49-de51c69459d7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:55.125328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] The token cache is being invalidate because project 523ef39f270444e484455190a436df61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:55.125711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:55.126465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3e5c1798-8ed2-4c33-bf49-de51c69459d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:55.128219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 876/1788] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:54 2022] DELETE /identity/v3/projects/523ef39f270444e484455190a436df61 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:55.134698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c33286-5042-456a-88b5-01d462c63d17 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.135132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c33286-5042-456a-88b5-01d462c63d17 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.135577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c33286-5042-456a-88b5-01d462c63d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.170610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-59c33286-5042-456a-88b5-01d462c63d17 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:55.172860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-59c33286-5042-456a-88b5-01d462c63d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:55.179504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 913/1789] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:54 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:21:55.186780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.191550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:55.193206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 877/1790] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:55.212429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5449-d7b8-4526-a2ab-b2cee450cc2e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.212429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5449-d7b8-4526-a2ab-b2cee450cc2e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.212429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5449-d7b8-4526-a2ab-b2cee450cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.252756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f2fd5449-d7b8-4526-a2ab-b2cee450cc2e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:55.257657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f2fd5449-d7b8-4526-a2ab-b2cee450cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:55.342972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2297-c28f-412c-b804-37498afd9dbc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.365118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.366183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.366662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.367300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.372266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.377843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.420542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 878/1791] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:55.426846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd5449-d7b8-4526-a2ab-b2cee450cc2e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.448386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd5449-d7b8-4526-a2ab-b2cee450cc2e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.457862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.459473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.459961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.460582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.462775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:55.462775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.469141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.498684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 879/1792] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:55.505751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.518803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77978a1-a406-4715-a208-b49f404cec83 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.526298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.527264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.528195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.528490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.529262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.531498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.561920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 914/1793] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:55 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:55.566450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.581638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e50d-5509-40e9-8337-cd7023d24740 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.591869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.592614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.592984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.593403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.594151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.596277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.614361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 915/1794] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:21:55.615538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.633702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076804-cfe1-4fdd-944f-90c7211fb593 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.644336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.649882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.649882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.649882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.649882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.649882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.665592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 916/1795] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:55.670507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.686250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d506-92ab-49bd-b397-b709e2b04d77 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.694007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836c1d3-2b4f-4a32-9fe7-ee0016b8dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.694881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c1d3-2b4f-4a32-9fe7-ee0016b8dab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.695679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c1d3-2b4f-4a32-9fe7-ee0016b8dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.695679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c1d3-2b4f-4a32-9fe7-ee0016b8dab1 admin admin] PATH_INFO: `/v3/projects/e4c671754c614ef2bc62c4070e42fb38/users/460c3b5dd1864979ace98ca0e642cf62/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.716173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836c1d3-2b4f-4a32-9fe7-ee0016b8dab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c671754c614ef2bc62c4070e42fb38, user_id=460c3b5dd1864979ace98ca0e642cf62, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.720115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836c1d3-2b4f-4a32-9fe7-ee0016b8dab1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.760063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 880/1796] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:55 2022] POST /identity/v3/projects => generated 379 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:55.764871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.827829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 917/1797] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:55 2022] PUT /identity/v3/projects/e4c671754c614ef2bc62c4070e42fb38/users/460c3b5dd1864979ace98ca0e642cf62/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:55.840223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.840870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.841154 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.864395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869aa7c-ff30-4d7e-8c95-d5dedb977ad0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.981283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] MFA Rules not processed for user `460c3b5dd1864979ace98ca0e642cf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:55.987206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.067490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.068150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.068438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.069968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.070612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.079945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.225490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 918/1798] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:56.226761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.231147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.269956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453def5a-4a6f-4392-842b-daff0cf354eb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:56.279706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 881/1799] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:55 2022] POST /identity/v3/users => generated 290 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:56.279706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.291129 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.291821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.292382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.292672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] PATH_INFO: `/v3/projects/15de085680074e8d9206dff0ea120a63` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.295138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15de085680074e8d9206dff0ea120a63)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.299054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.307228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a130-eeb1-4edc-ad57-f48a427d9a39 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:56.315088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.316323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.317159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.317539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.330050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.332487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.504895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 882/1800] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:56 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:56.508483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.545409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15de085680074e8d9206dff0ea120a63', 'request_id': 'req-34088b74-a320-48c8-8c68-7b4073c56139'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.572940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15de085680074e8d9206dff0ea120a63', 'request_id': 'req-34088b74-a320-48c8-8c68-7b4073c56139'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.656407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62431d86-8e53-4e3e-9e20-b98f6ed0a1a0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:56.722267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15de085680074e8d9206dff0ea120a63', 'request_id': 'req-34088b74-a320-48c8-8c68-7b4073c56139'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.736390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.737873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.738994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.739563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.742164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.747369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] The token cache is being invalidate because project 15de085680074e8d9206dff0ea120a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:56.748148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.748244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.749232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.752397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 919/1801] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:56 2022] DELETE /identity/v3/projects/15de085680074e8d9206dff0ea120a63 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:56.754299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.757156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.771196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 883/1802] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:56.772964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.778189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.781934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34088b74-a320-48c8-8c68-7b4073c56139 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:56.788869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.795301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.796220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.796995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.798501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.801311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.823456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187de0-68f1-43f0-a0be-9feab118322c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:56.833163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.834469 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.835129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.835737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] PATH_INFO: `/v3/users/e54b09ddfb8b4c7384f302efb732bfb0` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.838013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54b09ddfb8b4c7384f302efb732bfb0)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.842042 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.952662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 920/1803] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:56 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:56.954286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.957441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.985307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611018c-3d97-4f6e-b366-3efc267326bd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.000527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.001523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.002041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.002562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.004122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.007229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.021221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 921/1804] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:57.021907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.033778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a7036-b516-455a-b3cf-1321bd63368a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.041222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.041222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.041222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.041222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.042449 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.043707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.055624 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 922/1805] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:57.056582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.075368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bdca4-5947-4c08-9d7c-e329c78081a5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.083652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.087015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.087015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.087015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] PATH_INFO: `/v3/projects/161abb87bfdf4f0b8edbb7696ab95448/users/a0cbabeb185940d98ed7eba593d5f340/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.129664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=161abb87bfdf4f0b8edbb7696ab95448, user_id=a0cbabeb185940d98ed7eba593d5f340, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.139430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.186183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54b09ddfb8b4c7384f302efb732bfb0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:57.210891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54b09ddfb8b4c7384f302efb732bfb0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:57.210891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54b09ddfb8b4c7384f302efb732bfb0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:57.256697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 923/1806] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:57 2022] PUT /identity/v3/projects/161abb87bfdf4f0b8edbb7696ab95448/users/a0cbabeb185940d98ed7eba593d5f340/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:57.259887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.272494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:57.287313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:57.356266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54b09ddfb8b4c7384f302efb732bfb0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:57.357897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-cd4c3747-b9c5-4ffb-92e6-9df4064e1dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54b09ddfb8b4c7384f302efb732bfb0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:57.383306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3191a44-2598-492d-b14e-3c52b6418a2b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.393837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 884/1807] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:56 2022] DELETE /identity/v3/users/e54b09ddfb8b4c7384f302efb732bfb0 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:57.394086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.394086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.394086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.394086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.394589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.394761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.394761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.394761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.395107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.426665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 924/1808] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:57.427803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.442020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da801b-d4f9-4436-9b9b-ed52887efefb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.456761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] MFA Rules not processed for user `a0cbabeb185940d98ed7eba593d5f340`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:57.459511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:57.615575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb1932-efbf-4450-95e2-5685a4d6b702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.619429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1932-efbf-4450-95e2-5685a4d6b702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.620699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1932-efbf-4450-95e2-5685a4d6b702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.621838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1932-efbf-4450-95e2-5685a4d6b702 admin admin] PATH_INFO: `/v3/projects/98b106e1b2144c88b23f0a23f2119886/users/4891a616f69345759a86930e8eaf41dc/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.704420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb1932-efbf-4450-95e2-5685a4d6b702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b106e1b2144c88b23f0a23f2119886, user_id=4891a616f69345759a86930e8eaf41dc, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.710034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb1932-efbf-4450-95e2-5685a4d6b702 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.759913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 885/1809] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:57.767747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.770684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:57.787848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb29495-4113-44e8-b2f0-4862fabed9bb None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.795053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.795691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.796187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.796572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.797481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.799689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:58.193917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 925/1810] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:57 2022] PUT /identity/v3/projects/98b106e1b2144c88b23f0a23f2119886/users/4891a616f69345759a86930e8eaf41dc/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:58.213096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 886/1811] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:57 2022] POST /identity/v3/projects => generated 381 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:21:58.216796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:58.217398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8020106-beb7-4455-9109-3150ab2fb8fe None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:58.217966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8020106-beb7-4455-9109-3150ab2fb8fe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:58.219206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8020106-beb7-4455-9109-3150ab2fb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:58.293582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d8020106-beb7-4455-9109-3150ab2fb8fe None None] MFA Rules not processed for user `4891a616f69345759a86930e8eaf41dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:58.295608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8020106-beb7-4455-9109-3150ab2fb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:58.375555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf2679-4a3b-463a-828f-b75cee7a26ce admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:58.390524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c4be4-a31d-4e43-9b0b-1eb573d1ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:58.391863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4be4-a31d-4e43-9b0b-1eb573d1ba8d admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:58.392425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4be4-a31d-4e43-9b0b-1eb573d1ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:58.394907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4be4-a31d-4e43-9b0b-1eb573d1ba8d admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:58.395941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c4be4-a31d-4e43-9b0b-1eb573d1ba8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:58.400403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c4be4-a31d-4e43-9b0b-1eb573d1ba8d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:58.417477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 926/1812] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:58.428711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8020106-beb7-4455-9109-3150ab2fb8fe None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:58.442251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8020106-beb7-4455-9109-3150ab2fb8fe None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:58.447980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:58.450176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:58.450176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:58.450176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:58.450944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:58.453116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:58.645375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 887/1813] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:58 2022] POST /identity/v3/users => generated 297 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:58.648010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee409ad-4023-4a36-a427-355ea605c71a None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:58.648524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee409ad-4023-4a36-a427-355ea605c71a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:58.649011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee409ad-4023-4a36-a427-355ea605c71a None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:58.650663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 927/1814] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:58 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:58.652058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 888/1815] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:21:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:58.654313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:58.658029 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee409ad-4023-4a36-a427-355ea605c71a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:58.890090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee409ad-4023-4a36-a427-355ea605c71a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:58.916202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:58.917037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:58.917680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:58.923032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:58.940650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:58.954120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:59.021801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d419ac-2045-45ce-9548-e6005ed3679f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:59.036925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f48a62-bd07-4fe4-918b-e5a80e0dd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:59.037523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f48a62-bd07-4fe4-918b-e5a80e0dd135 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:59.037818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f48a62-bd07-4fe4-918b-e5a80e0dd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:59.038102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f48a62-bd07-4fe4-918b-e5a80e0dd135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:59.045269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f48a62-bd07-4fe4-918b-e5a80e0dd135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:59.049891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f48a62-bd07-4fe4-918b-e5a80e0dd135 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:59.086100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 928/1816] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:59.094105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:59.094659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:59.095239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:59.109044 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 889/1817] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:58 2022] POST /identity/v3/users => generated 300 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:59.110975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:59.120668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:59.127177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:59.128677 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:59.152942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3e57-ba60-42a7-833b-63475c9e9913 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:59.163132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:59.164931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:59.165514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:59.166103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] PATH_INFO: `/v3/projects/c89c2889f1054d6bad06dbd7b086a81d` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:59.169404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89c2889f1054d6bad06dbd7b086a81d)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:59.175124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:59.236146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 929/1818] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:59.239836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:59.241696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:59.260119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1e886-0c10-4f8a-bbc6-7e46bce08a88 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:59.268492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:59.269504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:59.269918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:59.270430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] PATH_INFO: `/v3/users/aca52c8e7e484ddf8b7d8dd097958787` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:59.272682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca52c8e7e484ddf8b7d8dd097958787)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:59.283145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:59.399306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89c2889f1054d6bad06dbd7b086a81d', 'request_id': 'req-240d8481-c13f-4e22-aaa9-852ada90a79a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.408717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89c2889f1054d6bad06dbd7b086a81d', 'request_id': 'req-240d8481-c13f-4e22-aaa9-852ada90a79a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.561915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89c2889f1054d6bad06dbd7b086a81d', 'request_id': 'req-240d8481-c13f-4e22-aaa9-852ada90a79a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.589095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] The token cache is being invalidate because project c89c2889f1054d6bad06dbd7b086a81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:59.590146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.591453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.601307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 890/1819] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:59 2022] DELETE /identity/v3/projects/c89c2889f1054d6bad06dbd7b086a81d => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:59.603011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:59.606345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:59.682961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca52c8e7e484ddf8b7d8dd097958787'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.690532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:59.707141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca52c8e7e484ddf8b7d8dd097958787'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.719534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca52c8e7e484ddf8b7d8dd097958787'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.720345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca52c8e7e484ddf8b7d8dd097958787'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.733529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d8481-c13f-4e22-aaa9-852ada90a79a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:59.741883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:59.743083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:59.743576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:59.744054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] PATH_INFO: `/v3/projects/12729be4183f4cf0971b1e233661e4db/users/728c4ccd302146238604aa170a6eb456/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:59.772570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:59.775763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12729be4183f4cf0971b1e233661e4db, user_id=728c4ccd302146238604aa170a6eb456, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:59.781740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:59.830974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca52c8e7e484ddf8b7d8dd097958787'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:59.847260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 930/1820] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:59 2022] DELETE /identity/v3/users/aca52c8e7e484ddf8b7d8dd097958787 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:59.852365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:59.852365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:59.961204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 891/1821] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:59 2022] PUT /identity/v3/projects/12729be4183f4cf0971b1e233661e4db/users/728c4ccd302146238604aa170a6eb456/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:59.963861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:59.967371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.022443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57e7f-1c6c-4e0e-a362-c09d4f426a09 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.166373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a24a7a-a1a1-46cb-a65c-898fc8931b3c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.175225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287cf71-ff32-4783-95b5-b8735e109d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.176459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287cf71-ff32-4783-95b5-b8735e109d72 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.176459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287cf71-ff32-4783-95b5-b8735e109d72 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.176665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287cf71-ff32-4783-95b5-b8735e109d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.179098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e287cf71-ff32-4783-95b5-b8735e109d72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.179244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303ec04-cd53-43d8-81fc-1da928e1a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.180337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ec04-cd53-43d8-81fc-1da928e1a5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.180934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ec04-cd53-43d8-81fc-1da928e1a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.181459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ec04-cd53-43d8-81fc-1da928e1a5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.182789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303ec04-cd53-43d8-81fc-1da928e1a5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.187185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303ec04-cd53-43d8-81fc-1da928e1a5cb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.201641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287cf71-ff32-4783-95b5-b8735e109d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.203348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287cf71-ff32-4783-95b5-b8735e109d72 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.217073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 931/1822] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:00.217073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.217073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.217073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.219146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 892/1823] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:00.220961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acddeb5-3084-4286-8d4c-6e8a53d2d1e0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.221409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acddeb5-3084-4286-8d4c-6e8a53d2d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.221695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acddeb5-3084-4286-8d4c-6e8a53d2d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.253732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:00.257277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.265356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0acddeb5-3084-4286-8d4c-6e8a53d2d1e0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:00.267544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0acddeb5-3084-4286-8d4c-6e8a53d2d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.282183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 932/1824] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:00.282183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:00.284344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.297626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 893/1825] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:00.297626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acddeb5-3084-4286-8d4c-6e8a53d2d1e0 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:00.303523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acddeb5-3084-4286-8d4c-6e8a53d2d1e0 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.305732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996f396-53e5-42a9-8977-ee5dbe1c7874 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.311335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.311803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799f2b0-61a6-49d8-af07-5c89caece826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.312048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.312334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.312616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] PATH_INFO: `/v3/projects/605591cde77e419c9264441938d3f40f/users/e7aa4d80bc444db98c3fa3f7d0e81a58/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.313328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799f2b0-61a6-49d8-af07-5c89caece826 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.313799 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799f2b0-61a6-49d8-af07-5c89caece826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.314229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799f2b0-61a6-49d8-af07-5c89caece826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.315231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799f2b0-61a6-49d8-af07-5c89caece826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.317877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799f2b0-61a6-49d8-af07-5c89caece826 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.333089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] RBAC: Authorizing `identity:create_grant(project_id=605591cde77e419c9264441938d3f40f, user_id=e7aa4d80bc444db98c3fa3f7d0e81a58, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.336352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.362195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 933/1826] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:00.362195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.362195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.362195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.390284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:00.393080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.413258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 934/1827] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:00.413258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:00.414661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.489425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 894/1828] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:00 2022] PUT /identity/v3/projects/605591cde77e419c9264441938d3f40f/users/e7aa4d80bc444db98c3fa3f7d0e81a58/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:00.491044 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:00.538785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825e878-5c91-4d0e-b8fb-b570e6e84dde None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.655557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.656603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.659685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.659685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.667035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581b35c-e3b6-404a-b341-7de64f2c074c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.674128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.677842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.678351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.679056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] PATH_INFO: `/v3/projects/12729be4183f4cf0971b1e233661e4db/users/728c4ccd302146238604aa170a6eb456/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.681816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=12729be4183f4cf0971b1e233661e4db, user_id=728c4ccd302146238604aa170a6eb456, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.685245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.685874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.688180 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.700650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 895/1829] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:00 2022] PUT /identity/v3/projects/12729be4183f4cf0971b1e233661e4db/users/728c4ccd302146238604aa170a6eb456/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:00.701773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:00.717639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 935/1830] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:00.719513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:00.780632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c1dbe-a92b-441c-8bd5-24b05b74b078 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.879953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96867432-6d54-4e40-b28d-08caa844164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.880651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867432-6d54-4e40-b28d-08caa844164f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.880939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867432-6d54-4e40-b28d-08caa844164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.881219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867432-6d54-4e40-b28d-08caa844164f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.881958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96867432-6d54-4e40-b28d-08caa844164f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.883934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96867432-6d54-4e40-b28d-08caa844164f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.900996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 936/1831] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:00.900996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f998df-c122-44b2-95b5-601fe0ad21df None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.900996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f998df-c122-44b2-95b5-601fe0ad21df None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.900996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f998df-c122-44b2-95b5-601fe0ad21df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.901393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb191dc-693b-41d2-9034-a3e1aed855ea admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.912093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.912741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.913471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.913471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.913967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:00.914276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.916105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:00.957425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 896/1832] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:00.957425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:00.960757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b114f-a2f9-43f3-a670-5eb2d0ed82ba admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:00.968112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:00.968913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:00.969147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:00.969430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] PATH_INFO: `/v3/projects/605591cde77e419c9264441938d3f40f/users/e7aa4d80bc444db98c3fa3f7d0e81a58/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:00.970243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e8f998df-c122-44b2-95b5-601fe0ad21df None None] MFA Rules not processed for user `728c4ccd302146238604aa170a6eb456`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:00.971565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e8f998df-c122-44b2-95b5-601fe0ad21df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:00.973527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] RBAC: Authorizing `identity:create_grant(project_id=605591cde77e419c9264441938d3f40f, user_id=e7aa4d80bc444db98c3fa3f7d0e81a58, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:00.984622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:01.201630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 897/1833] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:00 2022] PUT /identity/v3/projects/605591cde77e419c9264441938d3f40f/users/e7aa4d80bc444db98c3fa3f7d0e81a58/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:01.201630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:01.202717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 937/1834] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:01.202717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.202717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.202717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.203517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9106c-857b-42a1-851f-7fe37bf041de admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:01.203517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:01.203517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.203517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.204296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.204296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:01.204296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:01.204870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] MFA Rules not processed for user `e7aa4d80bc444db98c3fa3f7d0e81a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:01.204870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:01.284668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 938/1835] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:01.288140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:01.291416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:01.373958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 898/1836] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:01 2022] POST /identity/v3/projects => generated 383 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:01.373958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:01.379915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:01.440167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481bd35-9f60-4df8-8fda-e3aad0728398 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:01.502072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe561e-3655-467a-8498-6daeea9edfd8 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:01.507118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:01.512157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.512157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.512157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.535664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:01.536726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.537596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.537894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.609252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:01.612087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:01.624699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 899/1837] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:01.625815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:01.688465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:01.692696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:01.712781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 939/1838] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:01.714460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:01.717314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:01.729260 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a343-b37b-433a-9016-9b22e39ec7fc service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:01.741352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:01.742008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.742275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.742555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.743240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:01.745399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:01.753080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803f044-1ef0-4322-9c15-3a09a5b484a6 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:01.760954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:01.761819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.762382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.762657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] PATH_INFO: `/v3/projects/3236943fddfb4a41889dc52e98a874a6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.764040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3236943fddfb4a41889dc52e98a874a6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:01.766131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:01.910225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 900/1839] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:01 2022] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:01.914689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:01.926051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790052b1-2052-4239-b947-80a46deb530c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:01.931430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:01.932091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.932373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.932647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.933401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:01.935284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:01.951527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 901/1840] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:01.960862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:01.974313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e23c7e-efc0-45e0-bc11-4217f4ec7ea3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.000608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.000608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.000608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.000608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.001187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.008095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:02.015348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3236943fddfb4a41889dc52e98a874a6', 'request_id': 'req-cadb5f27-5cbe-4706-9769-943dd44b248e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.041397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 902/1841] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:02.050568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:02.052752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3236943fddfb4a41889dc52e98a874a6', 'request_id': 'req-cadb5f27-5cbe-4706-9769-943dd44b248e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.064306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1c2a0-37ef-4376-94af-1802ba7ce7f1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.135425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5f75d-bacc-4971-81fb-419af0ad1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.136329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f75d-bacc-4971-81fb-419af0ad1b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.137405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f75d-bacc-4971-81fb-419af0ad1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.137874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f75d-bacc-4971-81fb-419af0ad1b5a admin admin] PATH_INFO: `/v3/projects/a5ed8fe390b743e5a5616822db5a7793/users/23e8e81b11c34c4dae2716ff53cb53ad/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.166870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5f75d-bacc-4971-81fb-419af0ad1b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ed8fe390b743e5a5616822db5a7793, user_id=23e8e81b11c34c4dae2716ff53cb53ad, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.166870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5f75d-bacc-4971-81fb-419af0ad1b5a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:02.252313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3236943fddfb4a41889dc52e98a874a6', 'request_id': 'req-cadb5f27-5cbe-4706-9769-943dd44b248e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.277080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] The token cache is being invalidate because project 3236943fddfb4a41889dc52e98a874a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:02.278461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.283593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cadb5f27-5cbe-4706-9769-943dd44b248e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.286664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 940/1842] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:01 2022] DELETE /identity/v3/projects/3236943fddfb4a41889dc52e98a874a6 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:02.299328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642fa2-d8d0-4d7a-89c1-e5a000e2dd95 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.301276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642fa2-d8d0-4d7a-89c1-e5a000e2dd95 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.301978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642fa2-d8d0-4d7a-89c1-e5a000e2dd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.310671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 903/1843] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:02 2022] PUT /identity/v3/projects/a5ed8fe390b743e5a5616822db5a7793/users/23e8e81b11c34c4dae2716ff53cb53ad/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:02.312762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.314148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.314466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.366686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] MFA Rules not processed for user `23e8e81b11c34c4dae2716ff53cb53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:02.368289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:02.394368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-35642fa2-d8d0-4d7a-89c1-e5a000e2dd95 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:02.397813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-35642fa2-d8d0-4d7a-89c1-e5a000e2dd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:02.569949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 904/1844] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:02.576548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:02.583718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:02.586926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 941/1845] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:02.605102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfc9b9-e1df-4d85-ba9b-6706cadd85ff None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.605102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfc9b9-e1df-4d85-ba9b-6706cadd85ff None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.605102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfc9b9-e1df-4d85-ba9b-6706cadd85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.606991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac12638-9e08-460b-bb4c-0c03369beec9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.613656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.614187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.614474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.614879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.615479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.617998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:02.664562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3abfc9b9-e1df-4d85-ba9b-6706cadd85ff None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:02.675378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3abfc9b9-e1df-4d85-ba9b-6706cadd85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:02.715290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 942/1846] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:02.721978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfc9b9-e1df-4d85-ba9b-6706cadd85ff None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:02.748585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfc9b9-e1df-4d85-ba9b-6706cadd85ff None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.758214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.759395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.759868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.760437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.762171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:02.763000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.766439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:02.797536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 943/1847] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:02.802731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:02.817734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 905/1848] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:02.827563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:02.839239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7380-10e1-41c7-acb4-9ff80208f1b8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.965862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38f7ef-3c7e-4d78-8fac-8bbc39eb3bfb admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.966175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.967111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.967618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.968107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.969343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.971900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.972605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.972957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.973184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:02.973478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.974198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.976425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.212344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 906/1849] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/users => generated 300 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:03.216125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.217691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 944/1850] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/projects => generated 373 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:03.219113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.224121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:03.247970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dcd4a-836f-4fe3-b737-ef459a86e0e9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.309953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096e90c-282f-411e-9d8c-78911776cb12 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.318226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.319396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.319890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.320382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.321670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.325372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.334913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.336133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.339398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.339398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] PATH_INFO: `/v3/users/a0cbabeb185940d98ed7eba593d5f340` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.339398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cbabeb185940d98ed7eba593d5f340)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.343644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.344234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 945/1851] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:03.345218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.359420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:03.362468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cbe9a-8916-4b73-ac1b-52e2456b24c8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.371277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.371837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.372120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.372399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.373054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.375183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.666023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 946/1852] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:03 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:03.667511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.714399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7d669-077e-4375-ac4f-0f08f1f7f157 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.721386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.722409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.722409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.723140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] PATH_INFO: `/v3/projects/dd42cb0ca59c4713b364aebb9d272def/users/5ba13ef1e5684145bee5660295e1695d/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.749152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd42cb0ca59c4713b364aebb9d272def, user_id=5ba13ef1e5684145bee5660295e1695d, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.750208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.769869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cbabeb185940d98ed7eba593d5f340'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:03.796439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cbabeb185940d98ed7eba593d5f340'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:03.803866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cbabeb185940d98ed7eba593d5f340'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:03.920457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 947/1853] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:03 2022] PUT /identity/v3/projects/dd42cb0ca59c4713b364aebb9d272def/users/5ba13ef1e5684145bee5660295e1695d/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:03.922403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.925821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:04.063926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cbabeb185940d98ed7eba593d5f340'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:04.065329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cbabeb185940d98ed7eba593d5f340'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:04.101721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 907/1854] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:03 2022] DELETE /identity/v3/users/a0cbabeb185940d98ed7eba593d5f340 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:04.103531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.107656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:04.115460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317bdcd-31c1-42d2-86ca-6f564849013b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.229216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5856b-39a5-4298-88d1-2dd70a62abc1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.247589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8689c-f7e9-486e-9994-5eedf3aa279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.248637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8689c-f7e9-486e-9994-5eedf3aa279c admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.249123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8689c-f7e9-486e-9994-5eedf3aa279c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.250994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8689c-f7e9-486e-9994-5eedf3aa279c admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.252555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8689c-f7e9-486e-9994-5eedf3aa279c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.258536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8689c-f7e9-486e-9994-5eedf3aa279c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.266155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.266925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.267400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.267872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.269881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.272731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.288005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 908/1855] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:04.288005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9caa-2608-4e6b-9706-01ad95a99dea None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.288005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9caa-2608-4e6b-9706-01ad95a99dea None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.288005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9caa-2608-4e6b-9706-01ad95a99dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.304032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 948/1856] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:04.305627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.308422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:04.325150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e2ba9caa-2608-4e6b-9706-01ad95a99dea None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:04.329348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e2ba9caa-2608-4e6b-9706-01ad95a99dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:04.348610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 909/1857] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:04.348610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba9caa-2608-4e6b-9706-01ad95a99dea None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.377619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba9caa-2608-4e6b-9706-01ad95a99dea None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.393463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.394599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.395146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.395645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] PATH_INFO: `/v3/projects/dd42cb0ca59c4713b364aebb9d272def/users/5ba13ef1e5684145bee5660295e1695d/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.399337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd42cb0ca59c4713b364aebb9d272def, user_id=5ba13ef1e5684145bee5660295e1695d, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.405552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.420990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e47a5-6311-41d3-99fc-feca41c1bc86 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.428239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 910/1858] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:04 2022] PUT /identity/v3/projects/dd42cb0ca59c4713b364aebb9d272def/users/5ba13ef1e5684145bee5660295e1695d/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:04.429838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.495156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3db02-0199-4a8d-aece-c8ab38e3684b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.495923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3db02-0199-4a8d-aece-c8ab38e3684b service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.496254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3db02-0199-4a8d-aece-c8ab38e3684b service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.496649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3db02-0199-4a8d-aece-c8ab38e3684b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.498706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-76c3db02-0199-4a8d-aece-c8ab38e3684b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:04.546301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c494f-2b50-4f01-af28-33af5b4960c3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.552129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.552862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.553258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.553662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.554414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.556613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.580489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 911/1859] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:04.582525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.585226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:04.587899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3db02-0199-4a8d-aece-c8ab38e3684b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.592025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3db02-0199-4a8d-aece-c8ab38e3684b service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.612125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 949/1860] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:04.614346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.614919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.615391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.678082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] MFA Rules not processed for user `5ba13ef1e5684145bee5660295e1695d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:04.678082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:04.681211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:04.730840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f72e2f-fb77-437d-ba2f-cded7c27585f admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.762289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.764240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.764240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.764240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.791630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:04.795823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.798269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.814392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 912/1861] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:04.815538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.845308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09739de-3c9d-4602-b335-9b1fef35b4f9 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.860633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443af3-b75d-489f-922b-2afe8b02ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.862225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443af3-b75d-489f-922b-2afe8b02ed04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.862519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443af3-b75d-489f-922b-2afe8b02ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.863447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443af3-b75d-489f-922b-2afe8b02ed04 admin admin] PATH_INFO: `/v3/projects/66aa3bb75cad45d2babd72ab93a8c7ca/users/a9572227d1d349b1aa2a700839664ee3/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.928826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443af3-b75d-489f-922b-2afe8b02ed04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66aa3bb75cad45d2babd72ab93a8c7ca, user_id=a9572227d1d349b1aa2a700839664ee3, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.931843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 950/1862] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:04.933135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443af3-b75d-489f-922b-2afe8b02ed04 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:05.056673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:05.059541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:05.084640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df9b5e-e393-4260-a7a5-3503f8b42b41 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:05.097138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 913/1863] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:04 2022] PUT /identity/v3/projects/66aa3bb75cad45d2babd72ab93a8c7ca/users/a9572227d1d349b1aa2a700839664ee3/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:05.104783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4743730-c872-4530-82b9-bf2afef845bc None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:05.106063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4743730-c872-4530-82b9-bf2afef845bc None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:05.106493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4743730-c872-4530-82b9-bf2afef845bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:05.147415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d4743730-c872-4530-82b9-bf2afef845bc None None] MFA Rules not processed for user `a9572227d1d349b1aa2a700839664ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:05.149066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d4743730-c872-4530-82b9-bf2afef845bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:05.180664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:05.181422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:05.182004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:05.182675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:05.355165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 914/1864] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:05.361102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4743730-c872-4530-82b9-bf2afef845bc None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:05.363335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:05.365405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:05.379901 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 951/1865] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:05.487169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4743730-c872-4530-82b9-bf2afef845bc None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:05.492746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:05.493387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:05.493781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:05.494102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:05.494848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:05.497008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:05.694368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 915/1866] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:05 2022] POST /identity/v3/projects => generated 373 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:05.695321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:05.715164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e98f0-2060-44f8-8119-879597dd591b service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:05.843933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:05.844916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:05.845296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:05.845726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:05.846523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:05.848747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:06.011204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 952/1867] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:05 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:06.016288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:06.051367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e923d-ac11-4e56-b42f-bdb42642c0cd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:06.057455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:06.058097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:06.058937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:06.059253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:06.059912 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:06.061836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:06.075629 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 916/1868] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:06.085254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:06.095234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:06.105299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1996f12-5710-4379-9850-738e2910cc50 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:06.109397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bee48-a015-40e6-aca5-54cd3f7976c6 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:06.115563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:06.116689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:06.117021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:06.117462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:06.117985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] PATH_INFO: `/v3/users/23e8e81b11c34c4dae2716ff53cb53ad` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:06.118282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:06.119072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:06.119712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] PATH_INFO: `/v3/projects/9aa4e48f77874e05b25b3e962f8a0479/users/676bb0bdd1e541e6a7fc9356c8523e77/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:06.120044 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e8e81b11c34c4dae2716ff53cb53ad)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:06.123130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:06.195554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa4e48f77874e05b25b3e962f8a0479, user_id=676bb0bdd1e541e6a7fc9356c8523e77, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:06.199846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:06.330554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 953/1869] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:06 2022] PUT /identity/v3/projects/9aa4e48f77874e05b25b3e962f8a0479/users/676bb0bdd1e541e6a7fc9356c8523e77/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:06.339396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:06.342023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:06.427997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895516f-b74a-4dc4-822a-9966b091d162 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:06.490294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:06.490294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:06.490294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:06.490294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] PATH_INFO: `/v3/projects/161abb87bfdf4f0b8edbb7696ab95448` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:06.490968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=161abb87bfdf4f0b8edbb7696ab95448)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:06.490968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:07.618961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e8e81b11c34c4dae2716ff53cb53ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:07.645904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e8e81b11c34c4dae2716ff53cb53ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:07.647504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e8e81b11c34c4dae2716ff53cb53ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.069911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161abb87bfdf4f0b8edbb7696ab95448', 'request_id': 'req-f61a15e3-95fc-4d2c-89be-153b0c841956'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.076965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161abb87bfdf4f0b8edbb7696ab95448', 'request_id': 'req-f61a15e3-95fc-4d2c-89be-153b0c841956'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.293141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e8e81b11c34c4dae2716ff53cb53ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.294100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e8e81b11c34c4dae2716ff53cb53ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.337577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 917/1870] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:06 2022] DELETE /identity/v3/users/23e8e81b11c34c4dae2716ff53cb53ad => generated 0 bytes in 2243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:08.338956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:08.341085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.424933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c1565-3d84-4586-8159-47a509955765 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:08.430148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd77b5-0b59-41c6-ac04-e286225cc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:08.430819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd77b5-0b59-41c6-ac04-e286225cc919 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.431108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd77b5-0b59-41c6-ac04-e286225cc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.431387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd77b5-0b59-41c6-ac04-e286225cc919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:08.432052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd77b5-0b59-41c6-ac04-e286225cc919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:08.434556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd77b5-0b59-41c6-ac04-e286225cc919 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:08.453166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 918/1871] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:08.453166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592b81e-0905-4b51-a993-1001d80f25f3 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.453166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592b81e-0905-4b51-a993-1001d80f25f3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.453166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592b81e-0905-4b51-a993-1001d80f25f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:08.477349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0592b81e-0905-4b51-a993-1001d80f25f3 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:08.479641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0592b81e-0905-4b51-a993-1001d80f25f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.498170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 919/1872] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:08.499752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592b81e-0905-4b51-a993-1001d80f25f3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:08.518025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592b81e-0905-4b51-a993-1001d80f25f3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:08.525167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:08.526290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.527101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.527649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] PATH_INFO: `/v3/projects/9aa4e48f77874e05b25b3e962f8a0479/users/676bb0bdd1e541e6a7fc9356c8523e77/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:08.531887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa4e48f77874e05b25b3e962f8a0479, user_id=676bb0bdd1e541e6a7fc9356c8523e77, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:08.537676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:08.552867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161abb87bfdf4f0b8edbb7696ab95448', 'request_id': 'req-f61a15e3-95fc-4d2c-89be-153b0c841956'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.570612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 920/1873] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:08 2022] PUT /identity/v3/projects/9aa4e48f77874e05b25b3e962f8a0479/users/676bb0bdd1e541e6a7fc9356c8523e77/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:08.571974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:08.574770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.635223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] The token cache is being invalidate because project 161abb87bfdf4f0b8edbb7696ab95448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:08.636140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.639087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f61a15e3-95fc-4d2c-89be-153b0c841956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.647101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 954/1874] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:06 2022] DELETE /identity/v3/projects/161abb87bfdf4f0b8edbb7696ab95448 => generated 0 bytes in 2316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:08.652704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.654686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.660648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:08.729828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339ae2-ca54-40f8-9e74-9fe51f451f2e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:08.737122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:08.738156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.738613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.739136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:08.742798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.744900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] MFA Rules not processed for user `676bb0bdd1e541e6a7fc9356c8523e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:08.747402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.885626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 955/1875] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:08.885626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:08.885626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.892341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:08.894246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:08.896943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f39fca-b59b-4e45-8045-04685eae8ab9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:08.903112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:08.903600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.903924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.911727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 921/1876] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:08.912611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:08.914213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.919249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] PATH_INFO: `/v3/users/728c4ccd302146238604aa170a6eb456` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:08.921033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] RBAC: Authorizing `identity:delete_user(user_id=728c4ccd302146238604aa170a6eb456)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:08.923060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:08.990183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cb8fa-993d-4cd1-a266-c714f1d0220b service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:08.994292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:08.994971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.995252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.996106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:09.008057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:09.010111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:09.023712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 922/1877] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:09.255622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728c4ccd302146238604aa170a6eb456'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.272938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728c4ccd302146238604aa170a6eb456'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.283017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728c4ccd302146238604aa170a6eb456'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.284045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728c4ccd302146238604aa170a6eb456'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.407282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728c4ccd302146238604aa170a6eb456'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.410562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:09.423509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 956/1878] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:08 2022] DELETE /identity/v3/users/728c4ccd302146238604aa170a6eb456 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:09.520925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:09.523123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:09.546278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913c39-6465-4d38-a67a-8d4d6c815119 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:09.693410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:09.694609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:09.695114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:09.695576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] PATH_INFO: `/v3/projects/a5ed8fe390b743e5a5616822db5a7793` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:09.697142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ed8fe390b743e5a5616822db5a7793)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:09.699973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:10.011409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ed8fe390b743e5a5616822db5a7793', 'request_id': 'req-0909457e-0791-437d-b495-5a0b983ec96a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.023127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ed8fe390b743e5a5616822db5a7793', 'request_id': 'req-0909457e-0791-437d-b495-5a0b983ec96a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.218166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ed8fe390b743e5a5616822db5a7793', 'request_id': 'req-0909457e-0791-437d-b495-5a0b983ec96a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.256872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] The token cache is being invalidate because project a5ed8fe390b743e5a5616822db5a7793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:10.257157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:10.257698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.258144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.258617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:10.264924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 923/1879] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:09 2022] DELETE /identity/v3/projects/a5ed8fe390b743e5a5616822db5a7793 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:10.266012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:10.281626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:10.281904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82104c97-d7d6-45b5-a4a2-41a479eb527f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:10.368363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:10.368363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:10.368363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:10.368852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] PATH_INFO: `/v3/projects/12729be4183f4cf0971b1e233661e4db` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:10.370859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12729be4183f4cf0971b1e233661e4db)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:10.373365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:10.446032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909457e-0791-437d-b495-5a0b983ec96a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:10.455453 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:10.456461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:10.456952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:10.457465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] PATH_INFO: `/v3/users/5ba13ef1e5684145bee5660295e1695d` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:10.459214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba13ef1e5684145bee5660295e1695d)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:10.461724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:10.598193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12729be4183f4cf0971b1e233661e4db', 'request_id': 'req-d9f06e88-7eac-4286-9e93-ac3cbc36345d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.604598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12729be4183f4cf0971b1e233661e4db', 'request_id': 'req-d9f06e88-7eac-4286-9e93-ac3cbc36345d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.743295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12729be4183f4cf0971b1e233661e4db', 'request_id': 'req-d9f06e88-7eac-4286-9e93-ac3cbc36345d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.757918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] The token cache is being invalidate because project 12729be4183f4cf0971b1e233661e4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:10.758292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.759023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f06e88-7eac-4286-9e93-ac3cbc36345d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.760755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 957/1880] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:10 2022] DELETE /identity/v3/projects/12729be4183f4cf0971b1e233661e4db => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:10.770050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc86fa-e6f1-4060-aa1b-9b350d37b60b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:10.770820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc86fa-e6f1-4060-aa1b-9b350d37b60b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:10.771325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc86fa-e6f1-4060-aa1b-9b350d37b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:10.803989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d1dc86fa-e6f1-4060-aa1b-9b350d37b60b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:10.806059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d1dc86fa-e6f1-4060-aa1b-9b350d37b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:10.841900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba13ef1e5684145bee5660295e1695d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.867196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba13ef1e5684145bee5660295e1695d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.868677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba13ef1e5684145bee5660295e1695d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:10.952111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 958/1881] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:10.962921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75518-f3b1-45a1-8f6f-4c8cf9f04bd8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:10.963552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75518-f3b1-45a1-8f6f-4c8cf9f04bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:10.964925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75518-f3b1-45a1-8f6f-4c8cf9f04bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.000261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-09a75518-f3b1-45a1-8f6f-4c8cf9f04bd8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:11.002505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-09a75518-f3b1-45a1-8f6f-4c8cf9f04bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.007647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba13ef1e5684145bee5660295e1695d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:11.009211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba13ef1e5684145bee5660295e1695d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:11.017968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 959/1882] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:11.029005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75518-f3b1-45a1-8f6f-4c8cf9f04bd8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.034361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 924/1883] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:10 2022] DELETE /identity/v3/users/5ba13ef1e5684145bee5660295e1695d => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:11.046932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75518-f3b1-45a1-8f6f-4c8cf9f04bd8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.104219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.106946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.140587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.141575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.142006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.142409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.143406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:11.143820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.146497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:11.169372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 960/1884] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:11.172370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:11.176198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.194608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff403f-7837-4aa1-a8be-5aeed1f92ba3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.201753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.202657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.203045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.203391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.204224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.206995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:11.224580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739771-f133-41d4-8061-7816355f9011 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.230296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.231027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.231318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.231598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] PATH_INFO: `/v3/users/a9572227d1d349b1aa2a700839664ee3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.232968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9572227d1d349b1aa2a700839664ee3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.235130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:11.319939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 961/1885] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:11 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:11.325266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.483753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab15338-a354-4bc9-a07a-ccb8dd2f34ec admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.492811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.493878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.494386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.494929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.497006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.501080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:11.555032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9572227d1d349b1aa2a700839664ee3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:11.570521 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9572227d1d349b1aa2a700839664ee3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:11.571758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9572227d1d349b1aa2a700839664ee3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:11.670432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 962/1886] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:11 2022] POST /identity/v3/users => generated 292 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:11.679890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.685853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.697882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9572227d1d349b1aa2a700839664ee3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:11.698418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a6ea8-a73f-4bd6-8e31-a21fa332ad8b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.698780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-16985e48-4d00-4fc9-9e8b-79f4dd8fc88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9572227d1d349b1aa2a700839664ee3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:11.704020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.704587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.704873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.705157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.705866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.707588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:11.721034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 925/1887] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:11 2022] DELETE /identity/v3/users/a9572227d1d349b1aa2a700839664ee3 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:11.725017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 963/1888] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:11.728766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.729465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.730542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.731115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.748178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3ee1-ca6b-4f9b-ad8e-7372caee3036 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.762251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:11.764327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.863134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.864431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.865069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.865690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.867288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.870876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:11.880536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 926/1889] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:11.882087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.884894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.908507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 964/1890] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:11.909568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.909782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbaeb4-098d-489a-bb1a-eb4113fd7487 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.912670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.919904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.921634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.921634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.922149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] PATH_INFO: `/v3/projects/dd42cb0ca59c4713b364aebb9d272def` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.924116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd42cb0ca59c4713b364aebb9d272def)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.928604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:12.010225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87059c25-6f4a-4e99-b034-356beb927da4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:12.015160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:12.015877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.016262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.016588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.028216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.030611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:12.045704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 965/1891] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:12.046798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:12.060561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091ed3-3a44-44cc-8416-54c9a79656a2 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:12.067539 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c541e-b26a-46a6-9438-c1980d0a04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:12.068744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c541e-b26a-46a6-9438-c1980d0a04d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.069551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c541e-b26a-46a6-9438-c1980d0a04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.070081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c541e-b26a-46a6-9438-c1980d0a04d2 admin admin] PATH_INFO: `/v3/projects/abf59498da5f4dc59bf9e80be26a8c2e/users/b697d6e603814e24b1691f8db1d909dc/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.093354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c541e-b26a-46a6-9438-c1980d0a04d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf59498da5f4dc59bf9e80be26a8c2e, user_id=b697d6e603814e24b1691f8db1d909dc, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.097127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c541e-b26a-46a6-9438-c1980d0a04d2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:12.241276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 966/1892] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:12 2022] PUT /identity/v3/projects/abf59498da5f4dc59bf9e80be26a8c2e/users/b697d6e603814e24b1691f8db1d909dc/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:12.256292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd42cb0ca59c4713b364aebb9d272def', 'request_id': 'req-6b644f83-fe69-457f-8619-5363567a426f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.263279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.263741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.264192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.266578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd42cb0ca59c4713b364aebb9d272def', 'request_id': 'req-6b644f83-fe69-457f-8619-5363567a426f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.319875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] MFA Rules not processed for user `b697d6e603814e24b1691f8db1d909dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:12.322206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.413400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 967/1893] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:12.432528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:12.434830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.515857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd42cb0ca59c4713b364aebb9d272def', 'request_id': 'req-6b644f83-fe69-457f-8619-5363567a426f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.535314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d4d08-0d98-4176-b26b-8e71b73381ae None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:12.537006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] The token cache is being invalidate because project dd42cb0ca59c4713b364aebb9d272def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:12.538347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.539385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6b644f83-fe69-457f-8619-5363567a426f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.543670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375053d-f8af-4bd8-8a2b-f283728e6825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:12.543953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375053d-f8af-4bd8-8a2b-f283728e6825 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.544161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375053d-f8af-4bd8-8a2b-f283728e6825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.544579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375053d-f8af-4bd8-8a2b-f283728e6825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.548817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 927/1894] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:11 2022] DELETE /identity/v3/projects/dd42cb0ca59c4713b364aebb9d272def => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:12.550520 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b375053d-f8af-4bd8-8a2b-f283728e6825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.551417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f71ae-aaa9-4b4c-8221-89790cb580fd None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.551950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f71ae-aaa9-4b4c-8221-89790cb580fd None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.552455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f71ae-aaa9-4b4c-8221-89790cb580fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.568406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375053d-f8af-4bd8-8a2b-f283728e6825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.570200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375053d-f8af-4bd8-8a2b-f283728e6825 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:12.592984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 968/1895] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:12.595589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7c5f71ae-aaa9-4b4c-8221-89790cb580fd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:12.597194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7c5f71ae-aaa9-4b4c-8221-89790cb580fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.609434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:12.706619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 928/1896] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:12.719754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0e2d-8b4a-4ce7-8f70-5c5eac4056c0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.720311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0e2d-8b4a-4ce7-8f70-5c5eac4056c0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.720742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0e2d-8b4a-4ce7-8f70-5c5eac4056c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.760801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-768d0e2d-8b4a-4ce7-8f70-5c5eac4056c0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:12.762359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-768d0e2d-8b4a-4ce7-8f70-5c5eac4056c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.796001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 969/1897] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:12.797440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f71ae-aaa9-4b4c-8221-89790cb580fd None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:12.812804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f71ae-aaa9-4b4c-8221-89790cb580fd None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:12.825902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:12.827185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.827704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.828208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.829472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:12.830043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.833326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:12.866694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 929/1898] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:12.866918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0e2d-8b4a-4ce7-8f70-5c5eac4056c0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:12.877368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0e2d-8b4a-4ce7-8f70-5c5eac4056c0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:12.885254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:12.886293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.886816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.887270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.888393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.892130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:12.942524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:12.944660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.962832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf9062-6ec3-4540-bd4f-3e83ebb4fbd1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:12.970163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:12.971805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.971805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.971968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] PATH_INFO: `/v3/projects/66aa3bb75cad45d2babd72ab93a8c7ca` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.973413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66aa3bb75cad45d2babd72ab93a8c7ca)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.976571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.073381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 970/1899] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:12 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:13.079967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.158290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16026e79-b67a-44f7-9d07-6ce3fceb322b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.177791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66aa3bb75cad45d2babd72ab93a8c7ca', 'request_id': 'req-e79603cb-9f14-45ea-a904-f0b40a759d19'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.190728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66aa3bb75cad45d2babd72ab93a8c7ca', 'request_id': 'req-e79603cb-9f14-45ea-a904-f0b40a759d19'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.243940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.244922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.245241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.245853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.246610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.256774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.316354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66aa3bb75cad45d2babd72ab93a8c7ca', 'request_id': 'req-e79603cb-9f14-45ea-a904-f0b40a759d19'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.341981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] The token cache is being invalidate because project 66aa3bb75cad45d2babd72ab93a8c7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:13.342834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.345985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.350336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 930/1900] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:12 2022] DELETE /identity/v3/projects/66aa3bb75cad45d2babd72ab93a8c7ca => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:13.356816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.360631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 971/1901] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:13 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:13.361934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:13.362959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.364861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:13.379564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c284d-ac8a-4a3c-b9a7-13cdcfcdc753 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.386176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.388317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.388317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.388317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.388785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.389013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79603cb-9f14-45ea-a904-f0b40a759d19 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.390473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.399967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.399967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.399967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.399967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] PATH_INFO: `/v3/users/676bb0bdd1e541e6a7fc9356c8523e77` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.401194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=676bb0bdd1e541e6a7fc9356c8523e77)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.405797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 972/1902] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:13.406022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.406816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.418559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee232bfa-b987-4481-a9e6-654273849bb6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.424107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.424752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.429716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.429716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.429716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.429716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.443234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 973/1903] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:13.448027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.462155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0dce5-fb26-47d1-8fd7-1d77fe84ab96 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.470795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b7d1-f209-4974-b59d-401c99ee1607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.471945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b7d1-f209-4974-b59d-401c99ee1607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.472451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b7d1-f209-4974-b59d-401c99ee1607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.472986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b7d1-f209-4974-b59d-401c99ee1607 admin admin] PATH_INFO: `/v3/projects/3860453192d04a2191d84c90ffaf10f3/users/bac36d54dffe4ee28580f4fd98ffcf59/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.503365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b7d1-f209-4974-b59d-401c99ee1607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3860453192d04a2191d84c90ffaf10f3, user_id=bac36d54dffe4ee28580f4fd98ffcf59, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.509725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b7d1-f209-4974-b59d-401c99ee1607 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.612199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 974/1904] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:13 2022] PUT /identity/v3/projects/3860453192d04a2191d84c90ffaf10f3/users/bac36d54dffe4ee28580f4fd98ffcf59/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:13.623474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.623783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.624128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.664620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] MFA Rules not processed for user `bac36d54dffe4ee28580f4fd98ffcf59`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:13.667055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:13.693562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676bb0bdd1e541e6a7fc9356c8523e77'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.713582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676bb0bdd1e541e6a7fc9356c8523e77'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.714620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676bb0bdd1e541e6a7fc9356c8523e77'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.765290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 975/1905] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:13.781792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.783924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:13.859785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6fc52-a290-42fd-b3ee-1ab76c3c1de0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.863934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.864580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.864865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.865143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.877367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.879215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.891511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 976/1906] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:13.914838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676bb0bdd1e541e6a7fc9356c8523e77'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.915615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.916048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aef039cc-18c5-415c-83fe-a5c964da43bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676bb0bdd1e541e6a7fc9356c8523e77'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.919724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:13.940358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 931/1907] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:13 2022] DELETE /identity/v3/users/676bb0bdd1e541e6a7fc9356c8523e77 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:14.021495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff5e4-68f3-4ab0-867a-e16cecec2ae9 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:14.127394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:14.128951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.129604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.130168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] PATH_INFO: `/v3/users/bac36d54dffe4ee28580f4fd98ffcf59` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.133093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac36d54dffe4ee28580f4fd98ffcf59)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:14.139141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:14.373042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac36d54dffe4ee28580f4fd98ffcf59'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.390193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac36d54dffe4ee28580f4fd98ffcf59'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.403978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac36d54dffe4ee28580f4fd98ffcf59'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.405179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac36d54dffe4ee28580f4fd98ffcf59'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.502825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac36d54dffe4ee28580f4fd98ffcf59'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.510134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 977/1908] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:13 2022] DELETE /identity/v3/users/bac36d54dffe4ee28580f4fd98ffcf59 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:14.515489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.516159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.516159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.538212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:14.539495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:14.602295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:14.608885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:14.611393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:14.637070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 932/1909] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:14.649750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:14.651740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:14.771532 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7b208-1534-4c72-842c-b7910440ed9c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:14.783482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:14.787770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.787770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.787770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] PATH_INFO: `/v3/projects/9aa4e48f77874e05b25b3e962f8a0479` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.789914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa4e48f77874e05b25b3e962f8a0479)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:14.794607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:14.809207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d781b5-7665-4add-91f6-86e7e19f1843 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:14.816713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14fd4-50db-4e12-bc5e-5cde8d912e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:14.817897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14fd4-50db-4e12-bc5e-5cde8d912e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.818473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14fd4-50db-4e12-bc5e-5cde8d912e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.819022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14fd4-50db-4e12-bc5e-5cde8d912e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.838771 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14fd4-50db-4e12-bc5e-5cde8d912e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:14.842131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14fd4-50db-4e12-bc5e-5cde8d912e68 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:14.855286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 933/1910] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:15.028903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa4e48f77874e05b25b3e962f8a0479', 'request_id': 'req-8e6a43bd-f040-4964-b90c-b7422275fddf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:15.035308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa4e48f77874e05b25b3e962f8a0479', 'request_id': 'req-8e6a43bd-f040-4964-b90c-b7422275fddf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:15.145704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa4e48f77874e05b25b3e962f8a0479', 'request_id': 'req-8e6a43bd-f040-4964-b90c-b7422275fddf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:15.169168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] The token cache is being invalidate because project 9aa4e48f77874e05b25b3e962f8a0479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:15.169706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:15.170693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8e6a43bd-f040-4964-b90c-b7422275fddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:15.173511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 978/1911] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:14 2022] DELETE /identity/v3/projects/9aa4e48f77874e05b25b3e962f8a0479 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:15.179646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c8bc-df6c-4bbd-a915-f8410a430942 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.181217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c8bc-df6c-4bbd-a915-f8410a430942 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.182048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c8bc-df6c-4bbd-a915-f8410a430942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.223972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c063c8bc-df6c-4bbd-a915-f8410a430942 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:15.226800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c063c8bc-df6c-4bbd-a915-f8410a430942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:15.382887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 934/1912] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:15.391603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a35a3-911a-4146-910f-da26fd62dc53 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.391603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a35a3-911a-4146-910f-da26fd62dc53 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.393036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a35a3-911a-4146-910f-da26fd62dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.433030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:15.451546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-085a35a3-911a-4146-910f-da26fd62dc53 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:15.453911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-085a35a3-911a-4146-910f-da26fd62dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:15.472729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 979/1913] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:15.477967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063c8bc-df6c-4bbd-a915-f8410a430942 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:15.490921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063c8bc-df6c-4bbd-a915-f8410a430942 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:15.497075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:15.498545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.498545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.498545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.499455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:15.499455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:15.501303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:15.516883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 935/1914] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:15.523701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a35a3-911a-4146-910f-da26fd62dc53 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:15.534922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a35a3-911a-4146-910f-da26fd62dc53 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:15.544099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:15.545289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.545852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.546257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.547388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:15.551267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:15.577509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:15.597320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:15.652653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8db41-1e8e-40fe-941b-2c77e4edc0fd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:15.660125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:15.661050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.661430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.661801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] PATH_INFO: `/v3/projects/3860453192d04a2191d84c90ffaf10f3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.663676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3860453192d04a2191d84c90ffaf10f3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:15.665765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:15.735256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 980/1915] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:15 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:15.741948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:15.822614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdee8e-d421-49ec-8006-5ffb6e6eba59 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:15.828093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:15.828737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.829017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.829362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.830070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:15.832129 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:15.880470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3860453192d04a2191d84c90ffaf10f3', 'request_id': 'req-7143db0a-61eb-444b-b5ad-ae2e75f19186'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:15.895667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3860453192d04a2191d84c90ffaf10f3', 'request_id': 'req-7143db0a-61eb-444b-b5ad-ae2e75f19186'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:16.020873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 981/1916] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:15 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:16.023061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.029628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3860453192d04a2191d84c90ffaf10f3', 'request_id': 'req-7143db0a-61eb-444b-b5ad-ae2e75f19186'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:16.048549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf15b4-2fe4-4c4c-a4a4-93da73be1d5a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.055692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] The token cache is being invalidate because project 3860453192d04a2191d84c90ffaf10f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:16.056006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:16.056957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7143db0a-61eb-444b-b5ad-ae2e75f19186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:16.058959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 936/1917] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:15 2022] DELETE /identity/v3/projects/3860453192d04a2191d84c90ffaf10f3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:16.066432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5500-cc45-473e-bbd0-103be33ae983 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.066843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5500-cc45-473e-bbd0-103be33ae983 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.067357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5500-cc45-473e-bbd0-103be33ae983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.109595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-48cb5500-cc45-473e-bbd0-103be33ae983 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:16.112061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-48cb5500-cc45-473e-bbd0-103be33ae983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:16.182764 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.184070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.184578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.185081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.186289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.189432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.204421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 982/1918] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:16.209274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.213459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:16.252604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef5745-43f1-49e5-ab5e-c54135a927cf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.269081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.269731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.270017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.270503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.271388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.284997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.298945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 937/1919] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:16.303318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564d38d-9633-4209-a085-416b98ab0b7f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.303813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564d38d-9633-4209-a085-416b98ab0b7f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.304078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 983/1920] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:16.304426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564d38d-9633-4209-a085-416b98ab0b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.308445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.331930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1049e-0aa1-415d-80be-f89247d0fe77 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.336751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6564d38d-9633-4209-a085-416b98ab0b7f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:16.339918 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6564d38d-9633-4209-a085-416b98ab0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:16.342454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286251a-3a0d-4b90-b625-da9441dfe90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.343955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286251a-3a0d-4b90-b625-da9441dfe90e admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.344647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286251a-3a0d-4b90-b625-da9441dfe90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.345444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286251a-3a0d-4b90-b625-da9441dfe90e admin admin] PATH_INFO: `/v3/projects/c9781f9f8bbc48e09a6f2773e1832ba3/users/5a8135fcd1fd4b76b93de47b2bbba32a/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.349582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 938/1921] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:16.358376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564d38d-9633-4209-a085-416b98ab0b7f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.379730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564d38d-9633-4209-a085-416b98ab0b7f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.391020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286251a-3a0d-4b90-b625-da9441dfe90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9781f9f8bbc48e09a6f2773e1832ba3, user_id=5a8135fcd1fd4b76b93de47b2bbba32a, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.391691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.392719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.393236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.393711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.395051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:16.395491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.398803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.400225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286251a-3a0d-4b90-b625-da9441dfe90e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.441890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 939/1922] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:16.450479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.487493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234ff7c-b19f-4528-9c14-99d7f894ca59 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.498816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.499445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.499798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.500084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.500745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.502772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.570559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 984/1923] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:16 2022] PUT /identity/v3/projects/c9781f9f8bbc48e09a6f2773e1832ba3/users/5a8135fcd1fd4b76b93de47b2bbba32a/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:16.585889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8633df-d0fc-4cc2-9829-29656621134e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.586333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8633df-d0fc-4cc2-9829-29656621134e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.586853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8633df-d0fc-4cc2-9829-29656621134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.633884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bb8633df-d0fc-4cc2-9829-29656621134e None None] MFA Rules not processed for user `5a8135fcd1fd4b76b93de47b2bbba32a`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:16.636069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bb8633df-d0fc-4cc2-9829-29656621134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:16.726254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 940/1924] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:16.728185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.793941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 985/1925] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:16.800841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8633df-d0fc-4cc2-9829-29656621134e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.913989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4373-f317-4eb7-b999-54b998c41eb3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.926981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.926981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.926981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.926981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.927699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.931587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.959958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8633df-d0fc-4cc2-9829-29656621134e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.976836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.978482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.978939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.984204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.984204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.984204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.041493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 941/1926] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:17.048656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.063307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce78f31-7007-4c52-9a53-a6862adcf15b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.070761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.072342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.072939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.073215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.074251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.076938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.094592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 942/1927] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:17.101165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.114542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b6062-6117-48f7-999b-55e15d31306d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.122902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.123648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.124010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.124424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.125170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.127146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.143558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 943/1928] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:17.149408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.165535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 986/1929] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/projects => generated 363 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:17.168231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9e055-b9fe-4876-b567-c2e79dd978e9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.174235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.325531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12642a0-2cd8-4029-aa9b-768b092879a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.329355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12642a0-2cd8-4029-aa9b-768b092879a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.329355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12642a0-2cd8-4029-aa9b-768b092879a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.329355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12642a0-2cd8-4029-aa9b-768b092879a8 admin admin] PATH_INFO: `/v3/projects/258e4af45ad8479784f36abc6479433c/users/361822840aec40629c74149b31d43558/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.362561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12642a0-2cd8-4029-aa9b-768b092879a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258e4af45ad8479784f36abc6479433c, user_id=361822840aec40629c74149b31d43558, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.368156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12642a0-2cd8-4029-aa9b-768b092879a8 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.400136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bd93-f1b2-4c7e-a6f2-1ba174594c90 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.410207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.415499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.415499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.415499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.415499 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.416602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.524439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 944/1930] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:17 2022] PUT /identity/v3/projects/258e4af45ad8479784f36abc6479433c/users/361822840aec40629c74149b31d43558/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:17.537286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.537814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.538258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.576954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] MFA Rules not processed for user `361822840aec40629c74149b31d43558`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:17.578272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:17.624855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 987/1931] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:17 2022] POST /identity/v3/users => generated 288 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:17.631031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.652482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa60ea-cdca-4494-a5fc-a0b2cb08474a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.694010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:17.721068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 945/1932] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:17.739930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.743209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:17.780630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.781854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.782283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.782684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.783509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.785323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.811722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 988/1933] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:17.818389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.843876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790608d-00d1-46bd-9a06-8aeb5f72e95b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.854192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.855497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.856010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.856710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] PATH_INFO: `/v3/projects/902b1d3b42a94b5e8a6a0f4c77d9dd54/users/f1b9f4c6cdce4ae2b43cc5918a67d2a5/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.876689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec7a3a-a450-46a0-b139-462178aceda5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.884731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.886950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.887699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.888389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.893098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902b1d3b42a94b5e8a6a0f4c77d9dd54, user_id=f1b9f4c6cdce4ae2b43cc5918a67d2a5, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.900867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.911973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.914730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.934120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 946/1934] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:18.017041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 989/1935] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:17 2022] PUT /identity/v3/projects/902b1d3b42a94b5e8a6a0f4c77d9dd54/users/f1b9f4c6cdce4ae2b43cc5918a67d2a5/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:18.019203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.043870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fafab-408e-40a2-9171-1dd182c55932 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.165479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa18e8-51b3-4662-8f79-0b2b14d38623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.166793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa18e8-51b3-4662-8f79-0b2b14d38623 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.167837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa18e8-51b3-4662-8f79-0b2b14d38623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.168314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa18e8-51b3-4662-8f79-0b2b14d38623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.169494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa18e8-51b3-4662-8f79-0b2b14d38623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.172809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa18e8-51b3-4662-8f79-0b2b14d38623 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.211699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 947/1936] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:18.216456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.232632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd186-4969-4d6e-93d1-84c8a3a10428 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.238978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.240670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.240670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.241003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] PATH_INFO: `/v3/projects/902b1d3b42a94b5e8a6a0f4c77d9dd54/users/f1b9f4c6cdce4ae2b43cc5918a67d2a5/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.243992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=902b1d3b42a94b5e8a6a0f4c77d9dd54, user_id=f1b9f4c6cdce4ae2b43cc5918a67d2a5, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.248388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.264007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 990/1937] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:18 2022] PUT /identity/v3/projects/902b1d3b42a94b5e8a6a0f4c77d9dd54/users/f1b9f4c6cdce4ae2b43cc5918a67d2a5/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:18.277955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662769-947c-4696-80ca-e4f3c62f1a80 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.278271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662769-947c-4696-80ca-e4f3c62f1a80 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.278596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662769-947c-4696-80ca-e4f3c62f1a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.311699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ec662769-947c-4696-80ca-e4f3c62f1a80 None None] MFA Rules not processed for user `f1b9f4c6cdce4ae2b43cc5918a67d2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:18.313502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ec662769-947c-4696-80ca-e4f3c62f1a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.401145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 948/1938] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:18.417750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.420317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.492426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09660a4-f941-486c-8e2c-977a6d517d0d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.497246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf1a2-aa42-422c-b4d2-f93cc305d9d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.497902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf1a2-aa42-422c-b4d2-f93cc305d9d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.498187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf1a2-aa42-422c-b4d2-f93cc305d9d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.498463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf1a2-aa42-422c-b4d2-f93cc305d9d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.509602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf1a2-aa42-422c-b4d2-f93cc305d9d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.511309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf1a2-aa42-422c-b4d2-f93cc305d9d6 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.523077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 991/1939] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:18.560580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:19.991410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec662769-947c-4696-80ca-e4f3c62f1a80 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:20.085750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec662769-947c-4696-80ca-e4f3c62f1a80 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:20.091748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:20.092428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:20.092693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:20.093053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] PATH_INFO: `/v3/users/5a8135fcd1fd4b76b93de47b2bbba32a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:20.094282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8135fcd1fd4b76b93de47b2bbba32a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:20.096355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:20.346117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8135fcd1fd4b76b93de47b2bbba32a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.353105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:20.383215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8135fcd1fd4b76b93de47b2bbba32a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.384200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8135fcd1fd4b76b93de47b2bbba32a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.481243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8135fcd1fd4b76b93de47b2bbba32a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.482295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8135fcd1fd4b76b93de47b2bbba32a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.505083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 949/1940] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:19 2022] DELETE /identity/v3/users/5a8135fcd1fd4b76b93de47b2bbba32a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:20.509986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:20.510862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:20.510862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:20.536334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:20.538777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:20.628405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 992/1941] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:20.639968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:20.642124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:20.735134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eda5cd-c641-402b-a6d8-e4da502343a1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:20.740993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:20.740993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:20.741323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:20.741583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:20.758561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:20.761970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:20.784514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 950/1942] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:21.155246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:21.981739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:21.984111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:22.004141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5da94-cee2-46f0-b496-d645d6d6ec66 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:22.011302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:22.012369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:22.012950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:22.013522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] PATH_INFO: `/v3/projects/c9781f9f8bbc48e09a6f2773e1832ba3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:22.015949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9781f9f8bbc48e09a6f2773e1832ba3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:22.018723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:22.209814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9781f9f8bbc48e09a6f2773e1832ba3', 'request_id': 'req-35a49643-cf90-4623-9905-8d7e88b09940'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.220502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9781f9f8bbc48e09a6f2773e1832ba3', 'request_id': 'req-35a49643-cf90-4623-9905-8d7e88b09940'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.343326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9781f9f8bbc48e09a6f2773e1832ba3', 'request_id': 'req-35a49643-cf90-4623-9905-8d7e88b09940'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.358005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] The token cache is being invalidate because project c9781f9f8bbc48e09a6f2773e1832ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:22.358446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.359283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.360927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 993/1943] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:21 2022] DELETE /identity/v3/projects/c9781f9f8bbc48e09a6f2773e1832ba3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:22.366381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:22.385693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4036e0c-d96f-4a23-83b5-4f477589957e service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:22.469161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:22.469810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:22.470093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:22.470373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] PATH_INFO: `/v3/users/f1b9f4c6cdce4ae2b43cc5918a67d2a5` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:22.471671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b9f4c6cdce4ae2b43cc5918a67d2a5)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:22.473852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:22.750751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b9f4c6cdce4ae2b43cc5918a67d2a5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.768366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b9f4c6cdce4ae2b43cc5918a67d2a5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.769278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b9f4c6cdce4ae2b43cc5918a67d2a5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.919679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b9f4c6cdce4ae2b43cc5918a67d2a5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.920699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b9f4c6cdce4ae2b43cc5918a67d2a5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.942244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:22.943739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:22.951518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 951/1944] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:22 2022] DELETE /identity/v3/users/f1b9f4c6cdce4ae2b43cc5918a67d2a5 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:23.020502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a49643-cf90-4623-9905-8d7e88b09940 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:23.087863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519663d2-7ad1-48c1-9505-7acd6ec564b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:23.088479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519663d2-7ad1-48c1-9505-7acd6ec564b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.088765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519663d2-7ad1-48c1-9505-7acd6ec564b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.089087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519663d2-7ad1-48c1-9505-7acd6ec564b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.090918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-519663d2-7ad1-48c1-9505-7acd6ec564b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:23.157705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519663d2-7ad1-48c1-9505-7acd6ec564b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:23.159243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519663d2-7ad1-48c1-9505-7acd6ec564b9 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.179446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 994/1945] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:23.240935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:23.517116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:23.518656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:23.614938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877b30-33ac-4702-90a6-9956efc73f35 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:23.621769 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:23.622886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.623348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.623681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] PATH_INFO: `/v3/projects/902b1d3b42a94b5e8a6a0f4c77d9dd54` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.625017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] RBAC: Authorizing `identity:delete_project(project_id=902b1d3b42a94b5e8a6a0f4c77d9dd54)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:23.628329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.771106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902b1d3b42a94b5e8a6a0f4c77d9dd54', 'request_id': 'req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.785930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902b1d3b42a94b5e8a6a0f4c77d9dd54', 'request_id': 'req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.915768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902b1d3b42a94b5e8a6a0f4c77d9dd54', 'request_id': 'req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.939833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] The token cache is being invalidate because project 902b1d3b42a94b5e8a6a0f4c77d9dd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:23.940166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.941111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3ff09a5d-9ff8-4d50-a9f1-8d02c19a832d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.943618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 952/1946] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:23 2022] DELETE /identity/v3/projects/902b1d3b42a94b5e8a6a0f4c77d9dd54 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:23.955993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9976-3de8-42d2-82ef-63279ed48cef None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.956485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9976-3de8-42d2-82ef-63279ed48cef None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.956965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9976-3de8-42d2-82ef-63279ed48cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.984155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4a1a9976-3de8-42d2-82ef-63279ed48cef None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:23.985484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4a1a9976-3de8-42d2-82ef-63279ed48cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:24.060060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 995/1947] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:24.067155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f2c2-4208-4448-a531-c444e5ed3254 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.067452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f2c2-4208-4448-a531-c444e5ed3254 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.067732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f2c2-4208-4448-a531-c444e5ed3254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.095084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-dcf8f2c2-4208-4448-a531-c444e5ed3254 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:24.096741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-dcf8f2c2-4208-4448-a531-c444e5ed3254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:24.103583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:24.106075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 953/1948] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:24.110834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9976-3de8-42d2-82ef-63279ed48cef None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.121305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9976-3de8-42d2-82ef-63279ed48cef None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.126471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.127150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.127431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.127710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.128370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:24.129062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.130753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.143393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 996/1949] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:24.148106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f2c2-4208-4448-a531-c444e5ed3254 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.159025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f2c2-4208-4448-a531-c444e5ed3254 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.164909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.165600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.165903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.166188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.166897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.169363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.275894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 954/1950] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:24.278458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.290124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46a278-4e88-41ff-9875-49bfdc79be51 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.365949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.366587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.366924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.367205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.367859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.369914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.482114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 997/1951] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:24.486678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.498291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab46540-f69c-48ca-993a-2cb1dc407486 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.503727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.504363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.504639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.504914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.505560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.507584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.520472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 955/1952] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:24.524556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.536324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818887e9-1a8d-4215-a7d1-80a42a2bb3da admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.541391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4b536-8b39-472a-9889-cba5f126f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.542069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4b536-8b39-472a-9889-cba5f126f54e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.542414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4b536-8b39-472a-9889-cba5f126f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.542968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4b536-8b39-472a-9889-cba5f126f54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.543707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4b536-8b39-472a-9889-cba5f126f54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.545450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4b536-8b39-472a-9889-cba5f126f54e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.556996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 998/1953] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:24.562086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.574735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749aec2-2fe7-4e8c-8d8d-41f4851c2851 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.579853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.580534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.580812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.581090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] PATH_INFO: `/v3/projects/262ac9022163476eae96b64bd47be5a7/users/6cf667d36ec94dd6bfecbea309e0d4ac/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.608561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=262ac9022163476eae96b64bd47be5a7, user_id=6cf667d36ec94dd6bfecbea309e0d4ac, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.608561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.740196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 956/1954] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:24 2022] PUT /identity/v3/projects/262ac9022163476eae96b64bd47be5a7/users/6cf667d36ec94dd6bfecbea309e0d4ac/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:24.768608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7438-aae7-41b7-99a1-218abf2c8792 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.768608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7438-aae7-41b7-99a1-218abf2c8792 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.768608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7438-aae7-41b7-99a1-218abf2c8792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.775379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:24.818701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c68b7438-aae7-41b7-99a1-218abf2c8792 None None] MFA Rules not processed for user `6cf667d36ec94dd6bfecbea309e0d4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:24.820847 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c68b7438-aae7-41b7-99a1-218abf2c8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:24.901500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 999/1955] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:24.908283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.991449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7e1d-d0ca-4988-aeb9-3e43a4e9c96e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.998603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.999251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.999509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.999864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.000686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.002592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.187719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 957/1956] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:25.191012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7438-aae7-41b7-99a1-218abf2c8792 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.203142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7438-aae7-41b7-99a1-218abf2c8792 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.273697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.274364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.274761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.275120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.275840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.278790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.475162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1000/1957] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:25 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:25.479264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.490325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4c81e-204d-4f7f-b699-e667d2174e1b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.495236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.495886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.496173 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.496454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.497110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.498767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.510597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 958/1958] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:25.515055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.525600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f7a2-d646-463b-8968-ea2383ba487b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.532098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.533098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.533373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.533775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] PATH_INFO: `/v3/projects/037913245a164be191fe57204177cb30/users/8082fa142c9e41709caf33892bb884f1/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.553104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037913245a164be191fe57204177cb30, user_id=8082fa142c9e41709caf33892bb884f1, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.555841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.705118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1001/1959] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:25 2022] PUT /identity/v3/projects/037913245a164be191fe57204177cb30/users/8082fa142c9e41709caf33892bb884f1/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:25.708824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.726359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d7aa5-720e-4c08-8a76-09d36e9b3db3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.790813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3954d-5412-4881-bb88-e887975679f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.791427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3954d-5412-4881-bb88-e887975679f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.791706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3954d-5412-4881-bb88-e887975679f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.792163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3954d-5412-4881-bb88-e887975679f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.793167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3954d-5412-4881-bb88-e887975679f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.794935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3954d-5412-4881-bb88-e887975679f1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.805087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 959/1960] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:25.809754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.828812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429aeec-682e-4a47-886b-8f58a3b72dc9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.833583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.834319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.834607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.834918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] PATH_INFO: `/v3/projects/037913245a164be191fe57204177cb30/users/8082fa142c9e41709caf33892bb884f1/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.836915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] RBAC: Authorizing `identity:create_grant(project_id=037913245a164be191fe57204177cb30, user_id=8082fa142c9e41709caf33892bb884f1, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.840388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.847516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:25.854505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1002/1961] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:25 2022] PUT /identity/v3/projects/037913245a164be191fe57204177cb30/users/8082fa142c9e41709caf33892bb884f1/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:25.865492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.865783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.866063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.897238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] MFA Rules not processed for user `8082fa142c9e41709caf33892bb884f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:25.898493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:25.980043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 960/1962] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:26.157720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:26.160478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:26.246938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0163e34-0e9e-4a1b-9ae3-365ce07d3add admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:26.251001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:26.251842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:26.252184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:26.252574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:26.267909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:26.270266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:26.289202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1003/1963] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:26.478386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:26.480863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:26.487067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:26.497279 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6400d-78b3-4bbb-97a6-b4bdb5866d94 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:26.501909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:26.502742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:26.503031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:26.503324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:26.565076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:26.566587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:26.576534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 961/1964] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:27.862016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:27.863605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:27.996974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2a120-dc80-4b91-b0be-b35a5f5954a3 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:28.002790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:28.003794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:28.004226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:28.004676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] PATH_INFO: `/v3/users/361822840aec40629c74149b31d43558` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:28.006139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361822840aec40629c74149b31d43558)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:28.008962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:28.302145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:28.304350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:28.321126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edea586-a87f-4a4e-b5c7-00fb16555fe6 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:28.326651 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:28.327300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:28.327630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:28.327905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] PATH_INFO: `/v3/users/b697d6e603814e24b1691f8db1d909dc` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:28.329314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b697d6e603814e24b1691f8db1d909dc)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:28.331319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:28.507999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361822840aec40629c74149b31d43558'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.520859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361822840aec40629c74149b31d43558'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.528804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361822840aec40629c74149b31d43558'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.530010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361822840aec40629c74149b31d43558'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.614019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b697d6e603814e24b1691f8db1d909dc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.623238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21ce7712-db30-44a8-92fa-197456a53cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361822840aec40629c74149b31d43558'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.630982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1004/1965] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:27 2022] DELETE /identity/v3/users/361822840aec40629c74149b31d43558 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:28.635265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:28.635635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:28.636461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:28.640183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b697d6e603814e24b1691f8db1d909dc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.642344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b697d6e603814e24b1691f8db1d909dc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.657219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:28.658219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:28.742544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1005/1966] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:28.765097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:28.768685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:28.812387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:28.813278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b697d6e603814e24b1691f8db1d909dc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.814237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-40f6744e-cf21-4a42-8236-ef5315aacd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b697d6e603814e24b1691f8db1d909dc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.833402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 962/1967] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:28 2022] DELETE /identity/v3/users/b697d6e603814e24b1691f8db1d909dc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:28.833699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a201f0e-82a7-406b-adc8-6267e859becd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:28.837890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505480-72ff-48b9-af6f-329009539d1a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:28.838182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505480-72ff-48b9-af6f-329009539d1a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:28.838463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505480-72ff-48b9-af6f-329009539d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:28.861304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-69505480-72ff-48b9-af6f-329009539d1a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:28.862525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-69505480-72ff-48b9-af6f-329009539d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:28.892948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:28.893570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:28.893870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:28.894221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:28.936557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 963/1968] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:28.948340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505480-72ff-48b9-af6f-329009539d1a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:28.951225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-69505480-72ff-48b9-af6f-329009539d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:28.967438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:28.968899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:28.970813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505480-72ff-48b9-af6f-329009539d1a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:28.976983 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:28.977839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:28.978303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:28.978588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:28.981465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1006/1969] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:28.999035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:28.999035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:29.011120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 964/1970] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:29.103037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:29.609037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:29.611643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:29.632060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c22cf-3388-4cd4-8a5f-352f24082737 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:29.639135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:29.639959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:29.640385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:29.640782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] PATH_INFO: `/v3/projects/258e4af45ad8479784f36abc6479433c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:29.642977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] RBAC: Authorizing `identity:delete_project(project_id=258e4af45ad8479784f36abc6479433c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:29.646976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:29.700761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:29.703168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:29.727412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed754-9ff7-4939-babb-82cf00f7e0ac service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:29.735740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:29.736615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:29.737149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:29.737608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] PATH_INFO: `/v3/projects/abf59498da5f4dc59bf9e80be26a8c2e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:29.739130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf59498da5f4dc59bf9e80be26a8c2e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:29.741326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:29.861102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258e4af45ad8479784f36abc6479433c', 'request_id': 'req-052f2042-8fc1-459f-bd6f-d5de2873393f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:29.868273 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258e4af45ad8479784f36abc6479433c', 'request_id': 'req-052f2042-8fc1-459f-bd6f-d5de2873393f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:29.931774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf59498da5f4dc59bf9e80be26a8c2e', 'request_id': 'req-8d111d6d-d086-44b1-becc-c599740a1e97'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:29.940358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf59498da5f4dc59bf9e80be26a8c2e', 'request_id': 'req-8d111d6d-d086-44b1-becc-c599740a1e97'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.028594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258e4af45ad8479784f36abc6479433c', 'request_id': 'req-052f2042-8fc1-459f-bd6f-d5de2873393f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.045880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] The token cache is being invalidate because project 258e4af45ad8479784f36abc6479433c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:30.046382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.047518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.050159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1007/1971] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:29 2022] DELETE /identity/v3/projects/258e4af45ad8479784f36abc6479433c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:30.052394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.053816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.139128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f2042-8fc1-459f-bd6f-d5de2873393f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.160820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf59498da5f4dc59bf9e80be26a8c2e', 'request_id': 'req-8d111d6d-d086-44b1-becc-c599740a1e97'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.181062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] The token cache is being invalidate because project abf59498da5f4dc59bf9e80be26a8c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:30.181690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.183237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8d111d6d-d086-44b1-becc-c599740a1e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.184841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 965/1972] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:29 2022] DELETE /identity/v3/projects/abf59498da5f4dc59bf9e80be26a8c2e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:30.186516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58533-c5a2-444d-ab7b-86061266ece2 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.186859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58533-c5a2-444d-ab7b-86061266ece2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.187145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58533-c5a2-444d-ab7b-86061266ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.211415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3fc58533-c5a2-444d-ab7b-86061266ece2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:30.212952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3fc58533-c5a2-444d-ab7b-86061266ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.233341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.234139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.234505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.234826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] PATH_INFO: `/v3/users/460c3b5dd1864979ace98ca0e642cf62` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.236898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460c3b5dd1864979ace98ca0e642cf62)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.242739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.295121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 966/1973] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:30.296740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c8421-a5cb-4782-bbeb-0a7fdc072b48 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.297156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c8421-a5cb-4782-bbeb-0a7fdc072b48 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.297541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c8421-a5cb-4782-bbeb-0a7fdc072b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.320198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-096c8421-a5cb-4782-bbeb-0a7fdc072b48 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:30.321428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-096c8421-a5cb-4782-bbeb-0a7fdc072b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.330104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 967/1974] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:30.331570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253600a-5082-4b77-9979-8090813332b5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.331863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253600a-5082-4b77-9979-8090813332b5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.332289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253600a-5082-4b77-9979-8090813332b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.356774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3253600a-5082-4b77-9979-8090813332b5 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:30.358129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3253600a-5082-4b77-9979-8090813332b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.367823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 968/1975] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:30.369219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc0c5-1666-4420-9a23-0d849960c309 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.369513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc0c5-1666-4420-9a23-0d849960c309 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.369797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc0c5-1666-4420-9a23-0d849960c309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.397730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-28fdc0c5-1666-4420-9a23-0d849960c309 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:30.399340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-28fdc0c5-1666-4420-9a23-0d849960c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.409641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 969/1976] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:30.410598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdc0c5-1666-4420-9a23-0d849960c309 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.440151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdc0c5-1666-4420-9a23-0d849960c309 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.447017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.447650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.447933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.448356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.449020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:30.449862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.452318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.467550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 970/1977] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:30.468522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.479910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86244-dc49-41e2-8250-5643e88eae61 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.485009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.485751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.486112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.486475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.487245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:30.487624 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.489432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.505717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 971/1978] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:30.506959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.519780 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c658b-1a42-4042-acd7-701e80f68eb3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.522672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460c3b5dd1864979ace98ca0e642cf62'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.526920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.528110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.528759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.529221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.530079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.532423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.582407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460c3b5dd1864979ace98ca0e642cf62'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.593493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460c3b5dd1864979ace98ca0e642cf62'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.594869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460c3b5dd1864979ace98ca0e642cf62'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.669968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460c3b5dd1864979ace98ca0e642cf62'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.686234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 972/1979] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:30.686234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.688578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.696097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1008/1980] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:30 2022] DELETE /identity/v3/users/460c3b5dd1864979ace98ca0e642cf62 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:30.699513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.702858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.781140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4501-fd45-42ad-95af-7dbac3ec3c5c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.796117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c17e-a3c9-473c-9c97-19d428b2c207 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.801744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aaf57-d447-4a41-806f-9a82ff99a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.803081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aaf57-d447-4a41-806f-9a82ff99a3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.803081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aaf57-d447-4a41-806f-9a82ff99a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.803081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aaf57-d447-4a41-806f-9a82ff99a3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.803749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aaf57-d447-4a41-806f-9a82ff99a3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.807620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aaf57-d447-4a41-806f-9a82ff99a3b4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.884891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.885867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.886305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.886774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.887418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.889405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.962461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1009/1981] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:30.964414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527dc1-67a8-4065-a1fa-cf95a25ba0c4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.964771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527dc1-67a8-4065-a1fa-cf95a25ba0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.965058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527dc1-67a8-4065-a1fa-cf95a25ba0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.985210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-63527dc1-67a8-4065-a1fa-cf95a25ba0c4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:30.991188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-63527dc1-67a8-4065-a1fa-cf95a25ba0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.995066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1010/1982] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:30.996182 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527dc1-67a8-4065-a1fa-cf95a25ba0c4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.006519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527dc1-67a8-4065-a1fa-cf95a25ba0c4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.016994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.017625 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.017980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.018268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.018985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.020787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.023926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 973/1983] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:31.025335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.028448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:31.038811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1011/1984] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:31.039820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.051798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309838-2492-4cde-9349-ee2144a32f6b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.126603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ac4e1-73d7-47ae-8048-90f584d37252 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.130998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.131879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.132169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.132448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.139994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.140906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.141084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.141366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.142032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.144087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.212385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.217512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.239677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 974/1985] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:31.241468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.253813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c12d60-3e39-46f9-a0cb-c935f7f705db service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.262564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.263177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.263471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.263747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.264407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.265504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1012/1986] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:31 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:31.266061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.273268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.285324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 975/1987] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:31.287133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.299801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cc830-1ac4-41e3-b522-19b4e36a394e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.304716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f971-0f48-42a2-a99b-28ccaf10e2c5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.305320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29562c-b64a-49fc-94ad-88bf731ad4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.306052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29562c-b64a-49fc-94ad-88bf731ad4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.306413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29562c-b64a-49fc-94ad-88bf731ad4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.306622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29562c-b64a-49fc-94ad-88bf731ad4b2 admin admin] PATH_INFO: `/v3/projects/5953b40b996c41fc8238e7a20ccdb3ae/users/574db0b30a3d40abbcc5cbe2907531dc/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.328562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.329700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.330183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.330790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.331980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.332599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29562c-b64a-49fc-94ad-88bf731ad4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5953b40b996c41fc8238e7a20ccdb3ae, user_id=574db0b30a3d40abbcc5cbe2907531dc, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.336362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.340374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29562c-b64a-49fc-94ad-88bf731ad4b2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.420013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1013/1988] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:31.424849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.441926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 976/1989] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:31 2022] PUT /identity/v3/projects/5953b40b996c41fc8238e7a20ccdb3ae/users/574db0b30a3d40abbcc5cbe2907531dc/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:31.444666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab951a8-0adb-4b90-8f11-dbde07e489ca admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.462486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981b6cb-b2a5-43e4-a789-e3093d3498b3 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.462841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981b6cb-b2a5-43e4-a789-e3093d3498b3 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.463145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981b6cb-b2a5-43e4-a789-e3093d3498b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.486245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:31.511423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1981b6cb-b2a5-43e4-a789-e3093d3498b3 None None] MFA Rules not processed for user `574db0b30a3d40abbcc5cbe2907531dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:31.513517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1981b6cb-b2a5-43e4-a789-e3093d3498b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:31.557176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:31.560396 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.561036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.561317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.561592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.563217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.563907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.586961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1014/1990] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:31.586961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.600437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8bf9-54ca-414c-8af8-9152170c88d4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.610525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 977/1991] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:31.616641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981b6cb-b2a5-43e4-a789-e3093d3498b3 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.617010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fef7ae-1328-4bec-9eba-f1192146d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.618100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fef7ae-1328-4bec-9eba-f1192146d20f admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.618764 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fef7ae-1328-4bec-9eba-f1192146d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.619163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fef7ae-1328-4bec-9eba-f1192146d20f admin admin] PATH_INFO: `/v3/projects/489c0e9250df4ec8a6fe3a9f05487738/users/a6b613c1b205404daa2b40d25268fcd1/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.633057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981b6cb-b2a5-43e4-a789-e3093d3498b3 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.639675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fef7ae-1328-4bec-9eba-f1192146d20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=489c0e9250df4ec8a6fe3a9f05487738, user_id=a6b613c1b205404daa2b40d25268fcd1, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.641490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.642311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.642604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.642749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fef7ae-1328-4bec-9eba-f1192146d20f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.647278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.647278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.647677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.762104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1015/1992] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:31 2022] PUT /identity/v3/projects/489c0e9250df4ec8a6fe3a9f05487738/users/a6b613c1b205404daa2b40d25268fcd1/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:31.777135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.777135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.777135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.824022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] MFA Rules not processed for user `a6b613c1b205404daa2b40d25268fcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:31.826539 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:31.830665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 978/1993] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:31 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:31.841435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.914144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1016/1994] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:31.923307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf904-5c3a-431f-bb38-cf545afb9b1c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.929096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.929895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.930216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.937593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.937785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.937938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.938083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:31.938228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.002753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb2c64-3b74-4edc-8cd1-6ea64524333a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.010113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.010113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.010113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.010113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.021988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.023554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.036261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1017/1995] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:32.037683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.039988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.062539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 979/1996] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:31 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:32.064317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.064751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb312b6-1622-44f0-9a94-dc60927fde67 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.072856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.074466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.075112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.075862 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] PATH_INFO: `/v3/projects/e4c671754c614ef2bc62c4070e42fb38` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.078038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c671754c614ef2bc62c4070e42fb38)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.081239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2e7c3-aff2-4f83-a8a9-d9a8f31739a9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.081861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.088078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.089653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.089959 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.090221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.090933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.092858 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.106994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 980/1997] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:32.109503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.122306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a38ba8-e724-4e45-a156-d521c616117d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.127935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.128939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.129301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.129652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.130409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.132360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.146762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 981/1998] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:32.151238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.162612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f5f3-2482-4ea7-8f8d-98258aab0009 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.167606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28b06e-6b3d-44be-84cc-04e5d828e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.168451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b06e-6b3d-44be-84cc-04e5d828e020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.168732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b06e-6b3d-44be-84cc-04e5d828e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.169016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b06e-6b3d-44be-84cc-04e5d828e020 admin admin] PATH_INFO: `/v3/projects/df824aa6d5a44a4f89b827b83a653136/users/917aadf061bd40f8ac4ec2af8894f82d/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.186793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28b06e-6b3d-44be-84cc-04e5d828e020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df824aa6d5a44a4f89b827b83a653136, user_id=917aadf061bd40f8ac4ec2af8894f82d, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.189584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28b06e-6b3d-44be-84cc-04e5d828e020 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.292104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 982/1999] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:32 2022] PUT /identity/v3/projects/df824aa6d5a44a4f89b827b83a653136/users/917aadf061bd40f8ac4ec2af8894f82d/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:32.303061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b10a-61a9-4d1c-a93e-875208ebb2f9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.303348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b10a-61a9-4d1c-a93e-875208ebb2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.303633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b10a-61a9-4d1c-a93e-875208ebb2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.303954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c671754c614ef2bc62c4070e42fb38', 'request_id': 'req-786417ef-7bac-4ef3-ac11-15e712e3ab7a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.311637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c671754c614ef2bc62c4070e42fb38', 'request_id': 'req-786417ef-7bac-4ef3-ac11-15e712e3ab7a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.335541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0382b10a-61a9-4d1c-a93e-875208ebb2f9 None None] MFA Rules not processed for user `917aadf061bd40f8ac4ec2af8894f82d`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:32.337011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0382b10a-61a9-4d1c-a93e-875208ebb2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.414266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 983/2000] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:32.420484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b10a-61a9-4d1c-a93e-875208ebb2f9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.428294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c671754c614ef2bc62c4070e42fb38', 'request_id': 'req-786417ef-7bac-4ef3-ac11-15e712e3ab7a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.461114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] The token cache is being invalidate because project e4c671754c614ef2bc62c4070e42fb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:32.462151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.464741 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.471360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1018/2001] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:32 2022] DELETE /identity/v3/projects/e4c671754c614ef2bc62c4070e42fb38 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:32.475993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.480344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.585164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786417ef-7bac-4ef3-ac11-15e712e3ab7a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.594352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.596123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.596921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.597653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] PATH_INFO: `/v3/users/4891a616f69345759a86930e8eaf41dc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.601251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4891a616f69345759a86930e8eaf41dc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.605986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.611957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b10a-61a9-4d1c-a93e-875208ebb2f9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.619784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.622389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.622389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.622824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.624382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.628786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.789788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 984/2002] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:32 2022] POST /identity/v3/projects => generated 377 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:32.796020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.798031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.878873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce62371-5291-47d9-8500-1ef3dec1451d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.884130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.884755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.885129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.885330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.886109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.888133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.950234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4891a616f69345759a86930e8eaf41dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.964924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4891a616f69345759a86930e8eaf41dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.972417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4891a616f69345759a86930e8eaf41dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.973169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4891a616f69345759a86930e8eaf41dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:33.018430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 985/2003] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:32 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:33.022776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.033634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5a33-883a-40ea-908f-a27e1e267162 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.039644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.040562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.040926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.041203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.042677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.044524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.060241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 986/2004] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:33.065493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.084081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c63fe8-eab0-4e22-b432-557939d4a980 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.091501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.091869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.092160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.092440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] PATH_INFO: `/v3/projects/1c6e19fe290748f298bab88499f40098/users/4e2ef147802b4dd6900dd85a96e1ae89/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.110784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6e19fe290748f298bab88499f40098, user_id=4e2ef147802b4dd6900dd85a96e1ae89, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.113523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.137226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4891a616f69345759a86930e8eaf41dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:33.145838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1019/2005] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:32 2022] DELETE /identity/v3/users/4891a616f69345759a86930e8eaf41dc => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:33.344715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 987/2006] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:33 2022] PUT /identity/v3/projects/1c6e19fe290748f298bab88499f40098/users/4e2ef147802b4dd6900dd85a96e1ae89/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:33.349112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.350613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:33.458398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c603b-98bd-4016-bb29-8362d600cf0f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.564288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242acc-1e31-4be1-87f2-c7c31a9afb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.565431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242acc-1e31-4be1-87f2-c7c31a9afb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.565890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242acc-1e31-4be1-87f2-c7c31a9afb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.566360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242acc-1e31-4be1-87f2-c7c31a9afb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.567676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242acc-1e31-4be1-87f2-c7c31a9afb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.570859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242acc-1e31-4be1-87f2-c7c31a9afb35 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.591383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1020/2007] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:33.597752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.609198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ae5d-4ecc-48f8-8eeb-aae0160a879e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.614903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.615631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.615914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.616209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] PATH_INFO: `/v3/projects/1c6e19fe290748f298bab88499f40098/users/4e2ef147802b4dd6900dd85a96e1ae89/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.618357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6e19fe290748f298bab88499f40098, user_id=4e2ef147802b4dd6900dd85a96e1ae89, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.621760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.633870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 988/2008] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:33 2022] PUT /identity/v3/projects/1c6e19fe290748f298bab88499f40098/users/4e2ef147802b4dd6900dd85a96e1ae89/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:33.645586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.645878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.646176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.680586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] MFA Rules not processed for user `4e2ef147802b4dd6900dd85a96e1ae89`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:33.684053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:33.799428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.802829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.031249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:34.039350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1021/2009] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:34.063266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:34.064893 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.071089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd1dc-e5dc-428c-b51a-147ac78761dc admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:34.078313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:34.079564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.080103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.080782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] PATH_INFO: `/v3/projects/98b106e1b2144c88b23f0a23f2119886` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.083146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b106e1b2144c88b23f0a23f2119886)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:34.098374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:34.143876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598006c-0e82-42f5-a2f1-30a94eaece8f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:34.150452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:34.151853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:34.153219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.153765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.154166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.157249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.253868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b106e1b2144c88b23f0a23f2119886', 'request_id': 'req-5ce2b603-f449-4316-97d8-f06966483cb9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.264827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b106e1b2144c88b23f0a23f2119886', 'request_id': 'req-5ce2b603-f449-4316-97d8-f06966483cb9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.281825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:34.281825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:34.291315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1022/2010] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:34.293066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:34.294710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.309910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264453eb-e771-44c6-b7b2-9a03b1445a7f service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:34.401708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:34.402204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b106e1b2144c88b23f0a23f2119886', 'request_id': 'req-5ce2b603-f449-4316-97d8-f06966483cb9'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.402426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.403962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.403962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] PATH_INFO: `/v3/users/6cf667d36ec94dd6bfecbea309e0d4ac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.404673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf667d36ec94dd6bfecbea309e0d4ac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:34.406920 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:34.438267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] The token cache is being invalidate because project 98b106e1b2144c88b23f0a23f2119886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:34.439178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.440440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.443336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 989/2011] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:33 2022] DELETE /identity/v3/projects/98b106e1b2144c88b23f0a23f2119886 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:34.449894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:34.452497 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.476745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2b603-f449-4316-97d8-f06966483cb9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:34.484399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:34.485600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.486187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.486829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] PATH_INFO: `/v3/users/e7aa4d80bc444db98c3fa3f7d0e81a58` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.488967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7aa4d80bc444db98c3fa3f7d0e81a58)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:34.492785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:34.650812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf667d36ec94dd6bfecbea309e0d4ac'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.667624 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf667d36ec94dd6bfecbea309e0d4ac'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.682600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf667d36ec94dd6bfecbea309e0d4ac'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.683772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf667d36ec94dd6bfecbea309e0d4ac'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.791867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7aa4d80bc444db98c3fa3f7d0e81a58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.819148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7aa4d80bc444db98c3fa3f7d0e81a58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.830276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7aa4d80bc444db98c3fa3f7d0e81a58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.862614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e975c913-9853-4ab1-a741-0e3db75a57f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf667d36ec94dd6bfecbea309e0d4ac'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.877597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1023/2012] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:34 2022] DELETE /identity/v3/users/6cf667d36ec94dd6bfecbea309e0d4ac => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:34.885888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.890363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.890363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.927021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:34.927021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:35.036121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1024/2013] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:35.050844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:35.052361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:35.056913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7aa4d80bc444db98c3fa3f7d0e81a58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:35.058970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7aa4d80bc444db98c3fa3f7d0e81a58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:35.075277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 990/2014] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:34 2022] DELETE /identity/v3/users/e7aa4d80bc444db98c3fa3f7d0e81a58 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:35.169564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48156841-0c63-4947-a4ad-e37a83caa913 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:35.237944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:35.238715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:35.239067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:35.239538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:35.349765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:35.362281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:35.380825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1025/2015] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:35.980032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:35.981812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:36.004263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47eb9-2ecf-489c-9f9d-27e4dd710a30 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.004617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.007425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:36.012179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.013225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.013703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.014182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] PATH_INFO: `/v3/projects/605591cde77e419c9264441938d3f40f` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.016202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605591cde77e419c9264441938d3f40f)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.020048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.036276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d742-bdb2-452e-b6ff-4d7c83d6b8d3 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.041753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.042968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.043571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.044255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] PATH_INFO: `/v3/projects/262ac9022163476eae96b64bd47be5a7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.045755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=262ac9022163476eae96b64bd47be5a7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.047932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.161160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605591cde77e419c9264441938d3f40f', 'request_id': 'req-77509488-10fe-4ab5-8cdb-f0c966a6d837'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.169465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605591cde77e419c9264441938d3f40f', 'request_id': 'req-77509488-10fe-4ab5-8cdb-f0c966a6d837'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.183348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262ac9022163476eae96b64bd47be5a7', 'request_id': 'req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.190826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262ac9022163476eae96b64bd47be5a7', 'request_id': 'req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.257317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605591cde77e419c9264441938d3f40f', 'request_id': 'req-77509488-10fe-4ab5-8cdb-f0c966a6d837'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.279339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] The token cache is being invalidate because project 605591cde77e419c9264441938d3f40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:36.279853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.280973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77509488-10fe-4ab5-8cdb-f0c966a6d837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.283634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 991/2016] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:35 2022] DELETE /identity/v3/projects/605591cde77e419c9264441938d3f40f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:36.291437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4cb38-16a2-424c-be33-ae9dd4e01418 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.291961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4cb38-16a2-424c-be33-ae9dd4e01418 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.292480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4cb38-16a2-424c-be33-ae9dd4e01418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.325513 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bba4cb38-16a2-424c-be33-ae9dd4e01418 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:36.327869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bba4cb38-16a2-424c-be33-ae9dd4e01418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:36.417453 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262ac9022163476eae96b64bd47be5a7', 'request_id': 'req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.430768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 992/2017] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:36.432695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] The token cache is being invalidate because project 262ac9022163476eae96b64bd47be5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:36.433063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.433725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.435352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1026/2018] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:36 2022] DELETE /identity/v3/projects/262ac9022163476eae96b64bd47be5a7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:36.439667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.440374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e4e2-265f-4de4-8eb6-d9025b413777 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.440868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e4e2-265f-4de4-8eb6-d9025b413777 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.441192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:36.441445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e4e2-265f-4de4-8eb6-d9025b413777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.459775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66589c08-dcaf-4f24-9fbe-0af42c07c8fc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.470392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.471267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.471820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.472367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] PATH_INFO: `/v3/users/8082fa142c9e41709caf33892bb884f1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.472749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1e30e4e2-265f-4de4-8eb6-d9025b413777 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:36.474252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1e30e4e2-265f-4de4-8eb6-d9025b413777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:36.474440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8082fa142c9e41709caf33892bb884f1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.476814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.484491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 993/2019] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:36.489338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30e4e2-265f-4de4-8eb6-d9025b413777 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.500169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30e4e2-265f-4de4-8eb6-d9025b413777 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.505659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.506622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.506910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.507199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.507881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:36.508194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.509946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.530679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 994/2020] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:36.535729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.551828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc581-c84e-47bc-8407-c7d74dc4eae1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.561378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.565930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.565930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.565930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.565930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.568726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.724863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8082fa142c9e41709caf33892bb884f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.748777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8082fa142c9e41709caf33892bb884f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.759661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:36.759965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8082fa142c9e41709caf33892bb884f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.761172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8082fa142c9e41709caf33892bb884f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.775618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 995/2021] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:36 2022] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:36.781447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.871533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44641eb-da85-44e3-b635-46554003f65e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.874386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:36.877145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.877810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.878215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.878848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.879692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.882036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.891221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8082fa142c9e41709caf33892bb884f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:36.899038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1027/2022] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:36 2022] DELETE /identity/v3/users/8082fa142c9e41709caf33892bb884f1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:37.007534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 996/2023] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:36 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:37.013298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.014858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:37.094295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642a73-3e18-4e29-82fc-98662e22cbd5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.099798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.100493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.100818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.101086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.101765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.103701 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:37.116550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1028/2024] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:37.123847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.143397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f280c9-44fb-4ebf-901a-380b5c268298 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.151609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d70677-a161-4a36-97d2-93867d223e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.152600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70677-a161-4a36-97d2-93867d223e67 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.153047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70677-a161-4a36-97d2-93867d223e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.153516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70677-a161-4a36-97d2-93867d223e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.155021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d70677-a161-4a36-97d2-93867d223e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.158139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d70677-a161-4a36-97d2-93867d223e67 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:37.177796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 997/2025] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:37.182045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.207106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40010f-352a-4aab-bd0b-32b8fbac0a42 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.215037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.217885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.217885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.217885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] PATH_INFO: `/v3/projects/1f0d12683dab46edb0295fe820e6f162/users/2ed9b9e4fae945919852b91418434083/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.241547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0d12683dab46edb0295fe820e6f162, user_id=2ed9b9e4fae945919852b91418434083, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.245049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:37.333463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1029/2026] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:37 2022] PUT /identity/v3/projects/1f0d12683dab46edb0295fe820e6f162/users/2ed9b9e4fae945919852b91418434083/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:37.350568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24e59-79a4-4840-b5af-16bbf0852dbd None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.352302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24e59-79a4-4840-b5af-16bbf0852dbd None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.352302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24e59-79a4-4840-b5af-16bbf0852dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.395333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1cb24e59-79a4-4840-b5af-16bbf0852dbd None None] MFA Rules not processed for user `2ed9b9e4fae945919852b91418434083`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:37.396874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1cb24e59-79a4-4840-b5af-16bbf0852dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:37.462671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.466893 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:37.523631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 998/2027] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:37.525503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:37.534242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb24e59-79a4-4840-b5af-16bbf0852dbd None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.618761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264467c-8b2b-4d06-820b-73c56ea0b39c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.628178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.629632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.630238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.630898 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] PATH_INFO: `/v3/projects/037913245a164be191fe57204177cb30` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.633207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037913245a164be191fe57204177cb30)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.638429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:37.648348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb24e59-79a4-4840-b5af-16bbf0852dbd None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.657183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.665815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.665815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.665815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.665815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.665815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:37.819665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 999/2028] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:37 2022] POST /identity/v3/projects => generated 367 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:37.829724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.861432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037913245a164be191fe57204177cb30', 'request_id': 'req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:37.871573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037913245a164be191fe57204177cb30', 'request_id': 'req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:37.926583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6529f-f43c-4695-aaaa-a94e3bca5bdb admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.007083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037913245a164be191fe57204177cb30', 'request_id': 'req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.028359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.029590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.030334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.031015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.031621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] The token cache is being invalidate because project 037913245a164be191fe57204177cb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:38.032016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.032675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.033015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2b9726c3-7c3e-4a3b-b5cf-5fc586945dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.035107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1030/2029] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:37 2022] DELETE /identity/v3/projects/037913245a164be191fe57204177cb30 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:38.042824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.045355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515a9be-3ffc-4102-9a97-4d0cd9731a48 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.045786 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515a9be-3ffc-4102-9a97-4d0cd9731a48 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.046215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515a9be-3ffc-4102-9a97-4d0cd9731a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.072684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5515a9be-3ffc-4102-9a97-4d0cd9731a48 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:38.075443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5515a9be-3ffc-4102-9a97-4d0cd9731a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.084585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1031/2030] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:38.093455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe415-be08-4063-bb38-eed76de2a404 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.093823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe415-be08-4063-bb38-eed76de2a404 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.094229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe415-be08-4063-bb38-eed76de2a404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.117014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-076fe415-be08-4063-bb38-eed76de2a404 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:38.118247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-076fe415-be08-4063-bb38-eed76de2a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.127713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1032/2031] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:38.132527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fe415-be08-4063-bb38-eed76de2a404 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.143779 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fe415-be08-4063-bb38-eed76de2a404 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.148612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.149259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.149514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.149787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.150443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:38.150797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.153233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.167496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1033/2032] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:38.172505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.185297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7f4e6-149b-499a-b06f-6b783208de7f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.190742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.191559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.191944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.192312 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.193394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.196307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.212182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1000/2033] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:37 2022] POST /identity/v3/users => generated 290 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:38.214913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.218529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.238066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98bdd0-9801-4034-8974-96f1cb97b2b9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.245357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.246290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.246566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.246960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.247630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.249290 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.269026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1001/2034] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:38.284262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.284262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2d60-f6e2-4a35-940f-a973d6d27509 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.288148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.288922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.289211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.289489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] PATH_INFO: `/v3/projects/8a4b081090ff4e4fa483f60f5cdd1ace/users/f978a5cba7184c95a2de2268a1653848/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.313734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4b081090ff4e4fa483f60f5cdd1ace, user_id=f978a5cba7184c95a2de2268a1653848, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.316543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.329071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1034/2035] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:38 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:38.334776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.379916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:38.429439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a614cb9-689c-4dd4-82ed-11bab4f56a5a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.438479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.447008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.447008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.447008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.447008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.447008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.493566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1002/2036] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:38 2022] PUT /identity/v3/projects/8a4b081090ff4e4fa483f60f5cdd1ace/users/f978a5cba7184c95a2de2268a1653848/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:38.495908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.582255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce779-d0f1-406c-8a39-c2cb8e0fb4ac admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.587375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.588011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.588288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.588598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.589722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.591352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.607012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1003/2037] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:38.609677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.625767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1035/2038] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:38 2022] POST /identity/v3/users => generated 292 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:38.630614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.634157 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b39fa-6d2b-4895-b804-b2729dc7a59a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.643177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a37d6-c145-4893-9b85-3715933860c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.644793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a37d6-c145-4893-9b85-3715933860c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.645323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a37d6-c145-4893-9b85-3715933860c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.645794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a37d6-c145-4893-9b85-3715933860c8 admin admin] PATH_INFO: `/v3/projects/8a4b081090ff4e4fa483f60f5cdd1ace/users/f978a5cba7184c95a2de2268a1653848/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.648396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a37d6-c145-4893-9b85-3715933860c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4b081090ff4e4fa483f60f5cdd1ace, user_id=f978a5cba7184c95a2de2268a1653848, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.651724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ed68-fb5d-4074-8f8c-ca24d52b325c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.654700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a37d6-c145-4893-9b85-3715933860c8 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.661623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.663085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.663663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.664158 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.665626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.672299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.678699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1004/2039] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:38 2022] PUT /identity/v3/projects/8a4b081090ff4e4fa483f60f5cdd1ace/users/f978a5cba7184c95a2de2268a1653848/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:38.693792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.694216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.694604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.697917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1036/2040] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:38.703455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.721698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139978-4f89-4677-a969-8204e8079579 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.732564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] MFA Rules not processed for user `f978a5cba7184c95a2de2268a1653848`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:38.733808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.811279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.811849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.812124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.812359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.813035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.815372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.834552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1037/2041] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:38.843052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1005/2042] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:38.844111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.857359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5529172-4777-4411-8553-df082ba8b411 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.871994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ac3d-f4df-4b43-afca-2e811f9e092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.873167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ac3d-f4df-4b43-afca-2e811f9e092b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.873679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ac3d-f4df-4b43-afca-2e811f9e092b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.874197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ac3d-f4df-4b43-afca-2e811f9e092b admin admin] PATH_INFO: `/v3/projects/357146de5f2c46099d51a6b03ef9663d/users/7618b9eebfdf466d9011a53916e63262/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.880305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.882710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.909777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ac3d-f4df-4b43-afca-2e811f9e092b admin admin] RBAC: Authorizing `identity:create_grant(project_id=357146de5f2c46099d51a6b03ef9663d, user_id=7618b9eebfdf466d9011a53916e63262, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.916636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ac3d-f4df-4b43-afca-2e811f9e092b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.995377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22dbf-cc59-4cb0-aa20-9d343365f755 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.999480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:39.000121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.000432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.000718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.011259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:39.012716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:39.024487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1006/2043] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:39.025638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.028321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.050855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33d6ad-5d1d-4216-b269-7ae779c0479a service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:39.056401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:39.057762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.057855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.058402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] PATH_INFO: `/v3/users/a6b613c1b205404daa2b40d25268fcd1` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.059823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b613c1b205404daa2b40d25268fcd1)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:39.062118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:39.081280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1038/2044] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:38 2022] PUT /identity/v3/projects/357146de5f2c46099d51a6b03ef9663d/users/7618b9eebfdf466d9011a53916e63262/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:39.096587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f7655-94a9-413e-b667-ec78d451e99b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.097156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f7655-94a9-413e-b667-ec78d451e99b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.097580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f7655-94a9-413e-b667-ec78d451e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.134583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-098f7655-94a9-413e-b667-ec78d451e99b None None] MFA Rules not processed for user `7618b9eebfdf466d9011a53916e63262`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:39.136985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-098f7655-94a9-413e-b667-ec78d451e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.239554 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:39.276152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1039/2045] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:39.277012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f7655-94a9-413e-b667-ec78d451e99b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.359795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f7655-94a9-413e-b667-ec78d451e99b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:39.365839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:39.365839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.365839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.366238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.367999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.421207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b613c1b205404daa2b40d25268fcd1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.440938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b613c1b205404daa2b40d25268fcd1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.442303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b613c1b205404daa2b40d25268fcd1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.453836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:39.456959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:39.474906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1040/2046] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:39.476542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.533078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b613c1b205404daa2b40d25268fcd1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.533821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b613c1b205404daa2b40d25268fcd1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.575084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1007/2047] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:39 2022] DELETE /identity/v3/users/a6b613c1b205404daa2b40d25268fcd1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:39.576656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.578394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.581739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2256e-689b-40fa-8c52-923ee08e0fc1 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:39.659752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02dec4-216f-42ab-a759-d7580cf7a5e4 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:39.666249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7343a-ed4e-44dc-ac43-0a59932c1d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:39.668077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7343a-ed4e-44dc-ac43-0a59932c1d32 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.668510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7343a-ed4e-44dc-ac43-0a59932c1d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.668859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7343a-ed4e-44dc-ac43-0a59932c1d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.672235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:39.673433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e4e7343a-ed4e-44dc-ac43-0a59932c1d32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.674127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.675684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.676049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.676803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:39.679530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:39.768097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7343a-ed4e-44dc-ac43-0a59932c1d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:39.771449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7343a-ed4e-44dc-ac43-0a59932c1d32 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:39.789777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1008/2048] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:39.792976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.793487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.793960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.818336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:39.819599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.828800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1009/2049] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:39.845915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.848131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.867863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1041/2050] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:39 2022] POST /identity/v3/projects => generated 381 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:39.869279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.872346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.932507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa8a6-9723-432e-93c9-e1d94101da5b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:39.999206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75582d4-65b5-4229-a733-17f4dfdc2222 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.006059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.010935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.010935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.010935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.010935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.010935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.024412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.025062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.025348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.025625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.035872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.039520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.047620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1010/2051] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:40.113192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1042/2052] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:39 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:40.117381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.130436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc896b81-d5dc-44b3-b083-1b5281493e06 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.137608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.138333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.138772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.139063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.140018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.142146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.155927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1011/2053] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:40.160747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.174042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501574bd-2099-4120-bea8-9f461955341d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.179299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.180348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.180755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.181226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] PATH_INFO: `/v3/projects/7b3a12addce44bb6a282b4a2c0aa5eb4/users/78ca4fa6380a48a5a8754be0cd59aec4/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.199551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3a12addce44bb6a282b4a2c0aa5eb4, user_id=78ca4fa6380a48a5a8754be0cd59aec4, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.202300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.299660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1043/2054] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:40 2022] PUT /identity/v3/projects/7b3a12addce44bb6a282b4a2c0aa5eb4/users/78ca4fa6380a48a5a8754be0cd59aec4/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:40.305217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.320461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844381-308e-4e23-92b5-d82a406538fb admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.439643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be8ac-9712-4fdf-9bc4-e0e169548657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.440367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be8ac-9712-4fdf-9bc4-e0e169548657 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.440733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be8ac-9712-4fdf-9bc4-e0e169548657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.441203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be8ac-9712-4fdf-9bc4-e0e169548657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.442074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236be8ac-9712-4fdf-9bc4-e0e169548657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.444375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236be8ac-9712-4fdf-9bc4-e0e169548657 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.458676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1012/2055] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:40.464866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.476854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217af027-dd6a-4989-9ab8-bca0780e7d52 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.483269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.483987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.484270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.484550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] PATH_INFO: `/v3/projects/7b3a12addce44bb6a282b4a2c0aa5eb4/users/78ca4fa6380a48a5a8754be0cd59aec4/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.486760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3a12addce44bb6a282b4a2c0aa5eb4, user_id=78ca4fa6380a48a5a8754be0cd59aec4, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.489557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.503562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1044/2056] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:40 2022] PUT /identity/v3/projects/7b3a12addce44bb6a282b4a2c0aa5eb4/users/78ca4fa6380a48a5a8754be0cd59aec4/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:40.516318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8c38e-d0e8-4d2d-b957-82670ee9e63c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.516812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8c38e-d0e8-4d2d-b957-82670ee9e63c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.517299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8c38e-d0e8-4d2d-b957-82670ee9e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.538461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:40.566690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b0c8c38e-d0e8-4d2d-b957-82670ee9e63c None None] MFA Rules not processed for user `78ca4fa6380a48a5a8754be0cd59aec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:40.568768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b0c8c38e-d0e8-4d2d-b957-82670ee9e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:40.693267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1013/2057] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:40.723634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.727071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:40.873682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4bae-461e-484b-87d5-9a54cd068992 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.879725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8c38e-d0e8-4d2d-b957-82670ee9e63c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.880622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.881412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.881820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.882306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] PATH_INFO: `/v3/projects/489c0e9250df4ec8a6fe3a9f05487738` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.884062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489c0e9250df4ec8a6fe3a9f05487738)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.887172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.957098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8c38e-d0e8-4d2d-b957-82670ee9e63c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.961132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f2a44-5d76-4969-896f-514788c07b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.961777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2a44-5d76-4969-896f-514788c07b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.962228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2a44-5d76-4969-896f-514788c07b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.962511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2a44-5d76-4969-896f-514788c07b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.973285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f2a44-5d76-4969-896f-514788c07b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.974962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f2a44-5d76-4969-896f-514788c07b93 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.982462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:40.987991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1014/2058] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:41.053234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489c0e9250df4ec8a6fe3a9f05487738', 'request_id': 'req-c44df129-14c5-4c1d-85d4-3168b0deeb50'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.059925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489c0e9250df4ec8a6fe3a9f05487738', 'request_id': 'req-c44df129-14c5-4c1d-85d4-3168b0deeb50'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.176774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489c0e9250df4ec8a6fe3a9f05487738', 'request_id': 'req-c44df129-14c5-4c1d-85d4-3168b0deeb50'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.192167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] The token cache is being invalidate because project 489c0e9250df4ec8a6fe3a9f05487738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:41.192630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.193347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c44df129-14c5-4c1d-85d4-3168b0deeb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.195152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1045/2059] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:40 2022] DELETE /identity/v3/projects/489c0e9250df4ec8a6fe3a9f05487738 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:41.201439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c92fc7-dbf8-4315-a7ff-afd53d30510d None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.201728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c92fc7-dbf8-4315-a7ff-afd53d30510d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.202002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c92fc7-dbf8-4315-a7ff-afd53d30510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.222231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-80c92fc7-dbf8-4315-a7ff-afd53d30510d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:41.223566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-80c92fc7-dbf8-4315-a7ff-afd53d30510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:41.302455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1015/2060] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:41.315848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e50869-099e-496c-8aee-8d1d3f6b757e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.316130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e50869-099e-496c-8aee-8d1d3f6b757e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.316458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e50869-099e-496c-8aee-8d1d3f6b757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.338146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-85e50869-099e-496c-8aee-8d1d3f6b757e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:41.339518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-85e50869-099e-496c-8aee-8d1d3f6b757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:41.347804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1046/2061] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:41.352483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c92fc7-dbf8-4315-a7ff-afd53d30510d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.364410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c92fc7-dbf8-4315-a7ff-afd53d30510d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.370604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.371712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.372060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.372351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.373028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:41.373371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.375128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.392890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1016/2062] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:41.397821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e50869-099e-496c-8aee-8d1d3f6b757e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.410036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.411167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e50869-099e-496c-8aee-8d1d3f6b757e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.412058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:41.418296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.419068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.419473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.419821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.420762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.423839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.474340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:41.504946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2009b4-ffa5-4981-819a-9057b62913ed admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.508962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.509619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.509897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.510562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.512286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:41.585033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.586604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.587232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1047/2063] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:41 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:41.593450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.600572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1017/2064] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:41.671501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b551cc-f5d0-45f8-9219-e62bb89c78be admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.677949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.678667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.678943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.679214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.679875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.681955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.861060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1048/2065] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:41 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:41.865411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.877020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dba85-d43c-42a6-b0cb-e468f02aaa8c service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.882249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.882952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.883239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.883563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.884236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.885981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.898680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1018/2066] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:41.902120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.913040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d5b30-3354-48fb-a3f8-56fc8561d903 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.918855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6c655-b6be-45bb-b707-8f5aea91f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.919543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6c655-b6be-45bb-b707-8f5aea91f6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.919826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6c655-b6be-45bb-b707-8f5aea91f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.920104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6c655-b6be-45bb-b707-8f5aea91f6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.920764 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6c655-b6be-45bb-b707-8f5aea91f6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.922389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6c655-b6be-45bb-b707-8f5aea91f6b2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.933492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1049/2067] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:41.937781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.948231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85d867-443d-414a-ba01-acb6fa779f17 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.952993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.953694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.953958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.954234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] PATH_INFO: `/v3/projects/8e253597e705424ba1b7482d348282d1/users/3d97132534e146cc8cc67f29ad90525d/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.971505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e253597e705424ba1b7482d348282d1, user_id=3d97132534e146cc8cc67f29ad90525d, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.974371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.113794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1019/2068] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:41 2022] PUT /identity/v3/projects/8e253597e705424ba1b7482d348282d1/users/3d97132534e146cc8cc67f29ad90525d/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:42.126555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790883f-3a89-4efd-9160-a887e8a5ea8d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.126865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790883f-3a89-4efd-9160-a887e8a5ea8d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.127141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790883f-3a89-4efd-9160-a887e8a5ea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.159297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:42.177878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5790883f-3a89-4efd-9160-a887e8a5ea8d None None] MFA Rules not processed for user `3d97132534e146cc8cc67f29ad90525d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:42.180081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5790883f-3a89-4efd-9160-a887e8a5ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.280970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1050/2069] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:42.437977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.439963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.507146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce30e6f-383b-48b9-ab3d-577b705d5bb9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.510854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.511725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.512012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.512292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.521560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.523085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.534023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1020/2070] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:42.562097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790883f-3a89-4efd-9160-a887e8a5ea8d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.606742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:42.666251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790883f-3a89-4efd-9160-a887e8a5ea8d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.672587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.680215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.680215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.680215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] PATH_INFO: `/v3/users/3d97132534e146cc8cc67f29ad90525d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.680215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d97132534e146cc8cc67f29ad90525d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.680215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.785140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:42.940009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d97132534e146cc8cc67f29ad90525d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.957960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d97132534e146cc8cc67f29ad90525d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.967903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d97132534e146cc8cc67f29ad90525d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.969259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d97132534e146cc8cc67f29ad90525d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:43.066295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.069802 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-abbef5cf-b370-44ba-a5fb-27d4431c50e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d97132534e146cc8cc67f29ad90525d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:43.079256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6661c-7fce-483f-933c-9ad9adb00a08 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:43.091833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1051/2071] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:42 2022] DELETE /identity/v3/users/3d97132534e146cc8cc67f29ad90525d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:43.095665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.096058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.096366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.098086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:43.098989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.099584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.100060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.103669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:43.152872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:43.154972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:43.239987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:43.242949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.258043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1052/2072] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:43.268449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1021/2073] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:43.279246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.281451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:43.377658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4515e-3c3a-4003-bd17-f581b7945e9e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:43.383385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5220e-1d69-49c6-a502-096b09d8493f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:43.384027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5220e-1d69-49c6-a502-096b09d8493f service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.384304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5220e-1d69-49c6-a502-096b09d8493f service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.384584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5220e-1d69-49c6-a502-096b09d8493f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.400783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5220e-1d69-49c6-a502-096b09d8493f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:43.404387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5220e-1d69-49c6-a502-096b09d8493f service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.424685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1053/2074] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:44.156543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:44.159768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:44.176479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7368026-3404-462a-9ec4-df655647dc1a service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:44.189302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:44.189302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:44.189302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:44.189302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] PATH_INFO: `/v3/projects/8e253597e705424ba1b7482d348282d1` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:44.194570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e253597e705424ba1b7482d348282d1)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:44.202782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:44.407285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e253597e705424ba1b7482d348282d1', 'request_id': 'req-85c9a671-6d47-4cc9-9534-22030bb946e1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:44.422193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e253597e705424ba1b7482d348282d1', 'request_id': 'req-85c9a671-6d47-4cc9-9534-22030bb946e1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:44.471454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:44.543348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e253597e705424ba1b7482d348282d1', 'request_id': 'req-85c9a671-6d47-4cc9-9534-22030bb946e1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:44.560411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] The token cache is being invalidate because project 8e253597e705424ba1b7482d348282d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:44.560789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:44.561974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85c9a671-6d47-4cc9-9534-22030bb946e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:44.563716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1022/2075] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:44 2022] DELETE /identity/v3/projects/8e253597e705424ba1b7482d348282d1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:44.570938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ab55-a934-4cdf-bcba-f26464dae552 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:44.572363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ab55-a934-4cdf-bcba-f26464dae552 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:44.573443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ab55-a934-4cdf-bcba-f26464dae552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:44.589330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:44.629598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b765ab55-a934-4cdf-bcba-f26464dae552 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:44.632202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b765ab55-a934-4cdf-bcba-f26464dae552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:44.785931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1054/2076] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:44.802001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e6140-7476-47a6-93a3-48fe4d892854 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:44.802454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e6140-7476-47a6-93a3-48fe4d892854 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:44.802856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e6140-7476-47a6-93a3-48fe4d892854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:44.836701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-dd2e6140-7476-47a6-93a3-48fe4d892854 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:44.838137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-dd2e6140-7476-47a6-93a3-48fe4d892854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:44.848674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1023/2077] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:44.857735 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ab55-a934-4cdf-bcba-f26464dae552 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:44.871167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ab55-a934-4cdf-bcba-f26464dae552 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:44.877142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:44.878008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:44.878945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:44.879374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:44.880191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:44.880676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:44.882466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:44.899680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1055/2078] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:44.904278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e6140-7476-47a6-93a3-48fe4d892854 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:44.918011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e6140-7476-47a6-93a3-48fe4d892854 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:44.923236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:44.924076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:44.924405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:44.924634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:44.925524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:44.927527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:45.043078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1024/2079] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:44 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:45.047323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:45.059441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfd2eb-f9d7-4de2-a0a7-9ec0e62899ee admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:45.133042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:45.134024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.134537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.134997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.136951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:45.140643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:45.285495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1056/2080] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:45 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:45.287005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:45.311066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ead4d5-04de-4610-b4cd-473ff16acf82 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:45.321001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:45.322094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.322995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.323450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.324630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:45.327802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:45.367262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1025/2081] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:45.374063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:45.391912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21061eef-2a80-47ad-8efb-2f8af4fbc47d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:45.400312 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a8af0-6705-4767-b19b-c591a65c7eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:45.401687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a8af0-6705-4767-b19b-c591a65c7eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.402136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a8af0-6705-4767-b19b-c591a65c7eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.403672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a8af0-6705-4767-b19b-c591a65c7eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.403893 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a8af0-6705-4767-b19b-c591a65c7eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:45.406706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a8af0-6705-4767-b19b-c591a65c7eb3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:45.428580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1057/2082] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:45.430151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:45.453671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede888c1-f036-43b3-87de-5b12056411ed admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:45.462900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:45.467620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.467620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.467620 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] PATH_INFO: `/v3/projects/1291a3f047aa40278c9d3d048abc194e/users/cfa791db71dd4345ba4b5988a33ec533/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.519791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1291a3f047aa40278c9d3d048abc194e, user_id=cfa791db71dd4345ba4b5988a33ec533, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:45.527854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:45.672339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1026/2083] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:45 2022] PUT /identity/v3/projects/1291a3f047aa40278c9d3d048abc194e/users/cfa791db71dd4345ba4b5988a33ec533/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:45.691880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.692424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.698919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.730159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:45.732214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:45.812535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1058/2084] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:45.822817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:45.825575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:45.938540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:45.940400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:45.955961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c57eb-ad2c-4b9d-a8bd-6babee25a565 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:45.958544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0900f-7e19-45f3-bbd4-2379699d99d4 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:45.962319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:45.963227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.964268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.964689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:45.967693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] PATH_INFO: `/v3/users/7618b9eebfdf466d9011a53916e63262` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.967828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.967828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.967828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.968055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7618b9eebfdf466d9011a53916e63262)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:45.969795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:45.978557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:45.980418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.005416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1027/2085] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:46.235262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7618b9eebfdf466d9011a53916e63262'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.269750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7618b9eebfdf466d9011a53916e63262'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.287835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7618b9eebfdf466d9011a53916e63262'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.291323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7618b9eebfdf466d9011a53916e63262'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.367125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:46.369283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:46.392977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7673-30b6-48d8-9219-78c465a213d7 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:46.400797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:46.409427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.409427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.409427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] PATH_INFO: `/v3/users/ee5616fa1efa4fe4ba21c0368ac66b5d` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.409427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5616fa1efa4fe4ba21c0368ac66b5d)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:46.409427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.430168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf8f8845-a048-4979-a6e1-e70e56d463ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7618b9eebfdf466d9011a53916e63262'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.441626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1059/2086] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:45 2022] DELETE /identity/v3/users/7618b9eebfdf466d9011a53916e63262 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:46.445901 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.446196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.446470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.477954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:46.479379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:46.559308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1060/2087] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:46.570807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:46.572395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:46.687541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edcdc8-bf24-4e09-a11d-e8dfedd55ecb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:46.693627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8270f2-d189-47e7-9c51-b3cca4dfd5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:46.694311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8270f2-d189-47e7-9c51-b3cca4dfd5ea service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.694556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8270f2-d189-47e7-9c51-b3cca4dfd5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.694887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8270f2-d189-47e7-9c51-b3cca4dfd5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.710334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8270f2-d189-47e7-9c51-b3cca4dfd5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:46.712541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8270f2-d189-47e7-9c51-b3cca4dfd5ea service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.725979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1061/2088] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:46.843068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5616fa1efa4fe4ba21c0368ac66b5d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.876009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5616fa1efa4fe4ba21c0368ac66b5d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.877131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5616fa1efa4fe4ba21c0368ac66b5d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.991336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5616fa1efa4fe4ba21c0368ac66b5d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:46.992318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5616fa1efa4fe4ba21c0368ac66b5d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:47.039660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1028/2089] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:46 2022] DELETE /identity/v3/users/ee5616fa1efa4fe4ba21c0368ac66b5d => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:47.042113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:47.042410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:47.042730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:47.091839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:47.093108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:47.200499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:47.270996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1062/2090] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:47.287083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:47.292036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:47.297985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:47.471844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:47.473750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:47.502566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da355-3393-4c9e-95ae-1b3cc00c473c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:47.552709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:47.553457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:47.553790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:47.554051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] PATH_INFO: `/v3/projects/357146de5f2c46099d51a6b03ef9663d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:47.558490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357146de5f2c46099d51a6b03ef9663d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:47.560719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:47.592662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77444ea8-40f2-42a1-8d58-102d6a3d1137 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:47.603336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:47.606821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:47.606821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:47.606821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:47.632645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:47.641893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:47.696764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1029/2091] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:47.971984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357146de5f2c46099d51a6b03ef9663d', 'request_id': 'req-64334373-c370-4a50-9947-d56e37724a57'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:47.997053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357146de5f2c46099d51a6b03ef9663d', 'request_id': 'req-64334373-c370-4a50-9947-d56e37724a57'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.171134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357146de5f2c46099d51a6b03ef9663d', 'request_id': 'req-64334373-c370-4a50-9947-d56e37724a57'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.189335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] The token cache is being invalidate because project 357146de5f2c46099d51a6b03ef9663d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:48.189940 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.191002 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.194000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1063/2092] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:47 2022] DELETE /identity/v3/projects/357146de5f2c46099d51a6b03ef9663d => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:48.198584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:48.212465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8adc7-adc6-4969-8791-b0cfab95875a service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:48.314394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:48.315398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:48.315793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:48.316201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] PATH_INFO: `/v3/users/78ca4fa6380a48a5a8754be0cd59aec4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:48.319179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ca4fa6380a48a5a8754be0cd59aec4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:48.321789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:48.635547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ca4fa6380a48a5a8754be0cd59aec4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.651283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ca4fa6380a48a5a8754be0cd59aec4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.652147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ca4fa6380a48a5a8754be0cd59aec4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.797596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ca4fa6380a48a5a8754be0cd59aec4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.807721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ca4fa6380a48a5a8754be0cd59aec4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:48.810915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:48.812457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:48.833654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64334373-c370-4a50-9947-d56e37724a57 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:48.849048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:48.850781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:48.851268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:48.851709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] PATH_INFO: `/v3/projects/9e80941b87d64557a9d32e1fbf5f38a8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:48.855048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e80941b87d64557a9d32e1fbf5f38a8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:48.856636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:48.856846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:48.892172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1030/2093] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:48 2022] DELETE /identity/v3/users/78ca4fa6380a48a5a8754be0cd59aec4 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:49.087564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e80941b87d64557a9d32e1fbf5f38a8', 'request_id': 'req-564f2d75-9b4c-4197-8704-5aa2c5274b7d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.099305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e80941b87d64557a9d32e1fbf5f38a8', 'request_id': 'req-564f2d75-9b4c-4197-8704-5aa2c5274b7d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.201233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e80941b87d64557a9d32e1fbf5f38a8', 'request_id': 'req-564f2d75-9b4c-4197-8704-5aa2c5274b7d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.247804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] The token cache is being invalidate because project 9e80941b87d64557a9d32e1fbf5f38a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:49.256015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.256475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.262710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1064/2094] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:48 2022] DELETE /identity/v3/projects/9e80941b87d64557a9d32e1fbf5f38a8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:49.267615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:49.269495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:49.371300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268effbc-37fb-4087-a363-6371bc1954c0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:49.495661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:49.496555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:49.496776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:49.497224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] PATH_INFO: `/v3/users/5205d6de48d44f748f6dcfeb373e0618` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:49.498920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5205d6de48d44f748f6dcfeb373e0618)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:49.502288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:49.665177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:49.667455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:49.694894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f2d75-9b4c-4197-8704-5aa2c5274b7d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:49.702409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:49.703254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:49.703930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:49.704309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] PATH_INFO: `/v3/users/574db0b30a3d40abbcc5cbe2907531dc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:49.720861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=574db0b30a3d40abbcc5cbe2907531dc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:49.723167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:49.756942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5205d6de48d44f748f6dcfeb373e0618'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.792516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5205d6de48d44f748f6dcfeb373e0618'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.793344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5205d6de48d44f748f6dcfeb373e0618'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.933049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5205d6de48d44f748f6dcfeb373e0618'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.934270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5205d6de48d44f748f6dcfeb373e0618'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:49.966782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1031/2095] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:49 2022] DELETE /identity/v3/users/5205d6de48d44f748f6dcfeb373e0618 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:49.970822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:49.976716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.069223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574db0b30a3d40abbcc5cbe2907531dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.106411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574db0b30a3d40abbcc5cbe2907531dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.126188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:50.130781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574db0b30a3d40abbcc5cbe2907531dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.139951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574db0b30a3d40abbcc5cbe2907531dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.149108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32020107-ec3d-4412-990c-754350cb2c2c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:50.163649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:50.164351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.164673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.164920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] PATH_INFO: `/v3/projects/7b3a12addce44bb6a282b4a2c0aa5eb4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.178888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3a12addce44bb6a282b4a2c0aa5eb4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:50.180391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:50.229711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bceb6f56-9b54-4f6e-bb45-4cd07b3dd9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574db0b30a3d40abbcc5cbe2907531dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.239130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1065/2096] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:49 2022] DELETE /identity/v3/users/574db0b30a3d40abbcc5cbe2907531dc => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:50.247326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.247794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.248842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.318683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:50.322482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.425064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3a12addce44bb6a282b4a2c0aa5eb4', 'request_id': 'req-31d39f70-6424-4389-aca5-a8d46e6aa971'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.434399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3a12addce44bb6a282b4a2c0aa5eb4', 'request_id': 'req-31d39f70-6424-4389-aca5-a8d46e6aa971'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.513195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1066/2097] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:50.514652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:50.516187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.532039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce82e8-bbc6-4fa5-830e-c3eaccc3635d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:50.579840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3a12addce44bb6a282b4a2c0aa5eb4', 'request_id': 'req-31d39f70-6424-4389-aca5-a8d46e6aa971'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.599038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] The token cache is being invalidate because project 7b3a12addce44bb6a282b4a2c0aa5eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:50.599452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.600905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:50.605903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1032/2098] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:49 2022] DELETE /identity/v3/projects/7b3a12addce44bb6a282b4a2c0aa5eb4 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:50.607147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:50.610709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.620329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:50.624557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.624557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.624557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] PATH_INFO: `/v3/users/2ed9b9e4fae945919852b91418434083` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.624557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed9b9e4fae945919852b91418434083)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:50.627559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:50.722367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d39f70-6424-4389-aca5-a8d46e6aa971 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:50.727645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13797405-dbdc-4462-8daf-4f86cdb36848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:50.728400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13797405-dbdc-4462-8daf-4f86cdb36848 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.729337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13797405-dbdc-4462-8daf-4f86cdb36848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.729716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13797405-dbdc-4462-8daf-4f86cdb36848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.732701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-13797405-dbdc-4462-8daf-4f86cdb36848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.749219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13797405-dbdc-4462-8daf-4f86cdb36848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:50.751224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13797405-dbdc-4462-8daf-4f86cdb36848 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:50.763351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1033/2099] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:50.766188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293cb06-7a45-44a1-a138-29e68fb520e9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.766826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293cb06-7a45-44a1-a138-29e68fb520e9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.767307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293cb06-7a45-44a1-a138-29e68fb520e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.816087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6293cb06-7a45-44a1-a138-29e68fb520e9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:50.818488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6293cb06-7a45-44a1-a138-29e68fb520e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.855540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1034/2100] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:50.867010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed66c-5026-4165-81b4-7aaed81f41b4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.868278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed66c-5026-4165-81b4-7aaed81f41b4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.870326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed66c-5026-4165-81b4-7aaed81f41b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.926570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c70ed66c-5026-4165-81b4-7aaed81f41b4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:50.927897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c70ed66c-5026-4165-81b4-7aaed81f41b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.954686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1035/2101] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:50.956466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed66c-5026-4165-81b4-7aaed81f41b4 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:50.997475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed66c-5026-4165-81b4-7aaed81f41b4 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:51.011868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:51.012692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:51.015993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:51.016664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:51.017639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:51.018175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:51.020156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:51.063244 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1036/2102] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:51.071304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:51.081122 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed9b9e4fae945919852b91418434083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:51.124728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6441b-ceeb-4dec-829c-a032cd9ebb5a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:51.145944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed9b9e4fae945919852b91418434083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:51.150171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:51.151601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:51.153403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:51.153783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:51.156715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:51.161581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:51.170264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed9b9e4fae945919852b91418434083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:51.176632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed9b9e4fae945919852b91418434083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:51.323795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed9b9e4fae945919852b91418434083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:51.336137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1037/2103] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:51 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:51.340827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:51.347774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:51.355575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1067/2104] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:50 2022] DELETE /identity/v3/users/2ed9b9e4fae945919852b91418434083 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:51.371590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:51.372238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:51.506718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2736ad-542e-4cf1-b4a6-289d6aaacd44 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:51.512631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95b8a-2e14-4bc8-bf46-278b2461e8af admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:51.517632 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:51.518986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:51.519824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:51.520241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] PATH_INFO: `/v3/users/b9e5a2de79e64520a471abc3540d1922` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:51.522038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e5a2de79e64520a471abc3540d1922)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:51.522424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96165ad2-24d5-4f43-9e48-5a9f44d32a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:51.523297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96165ad2-24d5-4f43-9e48-5a9f44d32a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:51.523767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96165ad2-24d5-4f43-9e48-5a9f44d32a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:51.524190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96165ad2-24d5-4f43-9e48-5a9f44d32a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:51.525191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96165ad2-24d5-4f43-9e48-5a9f44d32a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:51.526083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:51.529702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96165ad2-24d5-4f43-9e48-5a9f44d32a9a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:51.698027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1068/2105] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:51 2022] POST /identity/v3/users => generated 289 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:51.700261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:51.700833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:51.701544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:51.783703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:51.784991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:51.807521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1069/2106] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:51.808732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:51.820672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:51.845583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae31349-848d-40cf-984c-d063a59312c8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:51.857649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e5a2de79e64520a471abc3540d1922'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:51.862777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:51.863717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:51.864175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:51.864700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] PATH_INFO: `/v3/projects/e020dc26ace547d18d28458e7c3d4117` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:51.866476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e020dc26ace547d18d28458e7c3d4117)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:51.868996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:51.899643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e5a2de79e64520a471abc3540d1922'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:51.902232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e5a2de79e64520a471abc3540d1922'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.025042 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e5a2de79e64520a471abc3540d1922'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.030070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e5a2de79e64520a471abc3540d1922'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.052803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:52.069888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1038/2107] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:51 2022] DELETE /identity/v3/users/b9e5a2de79e64520a471abc3540d1922 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:52.080159 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e020dc26ace547d18d28458e7c3d4117', 'request_id': 'req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.080643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:52.083167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.094787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e020dc26ace547d18d28458e7c3d4117', 'request_id': 'req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.228390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883a71-d84a-45be-9813-f3ef3fe23051 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:52.229363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e020dc26ace547d18d28458e7c3d4117', 'request_id': 'req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.239891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:52.241314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.242034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.242498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.243767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:52.245777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:52.261075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1039/2108] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:52.262436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:52.264457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.275275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] The token cache is being invalidate because project e020dc26ace547d18d28458e7c3d4117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:52.279629 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.280388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.287216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1070/2109] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:51 2022] DELETE /identity/v3/projects/e020dc26ace547d18d28458e7c3d4117 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:52.290614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:52.296093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.316213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:52.396971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b538ffd-aca1-4622-b473-c829ea1c15d2 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:52.415399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:52.416332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.417264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.417710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.420253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.424380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7ea1-2d27-4f3b-8d56-a685923ee6fc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:52.429883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:52.431235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.431235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.431517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] PATH_INFO: `/v3/projects/5953b40b996c41fc8238e7a20ccdb3ae` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.433465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5953b40b996c41fc8238e7a20ccdb3ae)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:52.438327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:52.440141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:52.442694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:52.463699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1040/2110] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:52.465385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:52.467928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.496036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a4338-a007-48a0-b424-8fbf922952d3 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:52.506678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f98e1-ca2b-4f9e-a543-2f2ffdabe6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:52.508080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f98e1-ca2b-4f9e-a543-2f2ffdabe6ef admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.508767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f98e1-ca2b-4f9e-a543-2f2ffdabe6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.509726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f98e1-ca2b-4f9e-a543-2f2ffdabe6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.512505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f98e1-ca2b-4f9e-a543-2f2ffdabe6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:52.518103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f98e1-ca2b-4f9e-a543-2f2ffdabe6ef admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:52.543509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1041/2111] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:52.544761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ae13-3685-40cb-a210-3e5169d52e2c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.545201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ae13-3685-40cb-a210-3e5169d52e2c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.545578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ae13-3685-40cb-a210-3e5169d52e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.572186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d1d9ae13-3685-40cb-a210-3e5169d52e2c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:52.574659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d1d9ae13-3685-40cb-a210-3e5169d52e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.588064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1042/2112] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:52.589013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9ae13-3685-40cb-a210-3e5169d52e2c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:52.601779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9ae13-3685-40cb-a210-3e5169d52e2c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:52.609280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5585d6-b7b0-4f8a-83d9-d34c1b8529f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:52.610046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5585d6-b7b0-4f8a-83d9-d34c1b8529f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.610333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5585d6-b7b0-4f8a-83d9-d34c1b8529f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.610690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5585d6-b7b0-4f8a-83d9-d34c1b8529f4 admin admin] PATH_INFO: `/v3/projects/613bb196e9644bf29c97114a37cd72da/users/28ce118c87904c0fb1ebb7789fce742f/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.637305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5585d6-b7b0-4f8a-83d9-d34c1b8529f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613bb196e9644bf29c97114a37cd72da, user_id=28ce118c87904c0fb1ebb7789fce742f, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:52.686072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5585d6-b7b0-4f8a-83d9-d34c1b8529f4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:52.687223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5953b40b996c41fc8238e7a20ccdb3ae', 'request_id': 'req-eaf5ea3c-58c0-4425-b40c-6d98077349dd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.704543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5953b40b996c41fc8238e7a20ccdb3ae', 'request_id': 'req-eaf5ea3c-58c0-4425-b40c-6d98077349dd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.830584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5953b40b996c41fc8238e7a20ccdb3ae', 'request_id': 'req-eaf5ea3c-58c0-4425-b40c-6d98077349dd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.859737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1043/2113] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:52 2022] PUT /identity/v3/projects/613bb196e9644bf29c97114a37cd72da/users/28ce118c87904c0fb1ebb7789fce742f/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:52.859737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.859737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.859737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.864464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] The token cache is being invalidate because project 5953b40b996c41fc8238e7a20ccdb3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:52.864824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.868524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-eaf5ea3c-58c0-4425-b40c-6d98077349dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.879870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1071/2114] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:52 2022] DELETE /identity/v3/projects/5953b40b996c41fc8238e7a20ccdb3ae => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:52.884300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87762f75-219f-4bcd-ad48-fd52357e5b30 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.890345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87762f75-219f-4bcd-ad48-fd52357e5b30 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.890345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87762f75-219f-4bcd-ad48-fd52357e5b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.919257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:52.924326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.957176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-87762f75-219f-4bcd-ad48-fd52357e5b30 None None] MFA Rules not processed for user `28ce118c87904c0fb1ebb7789fce742f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:52.958652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-87762f75-219f-4bcd-ad48-fd52357e5b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.041125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1044/2115] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:53.042750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:53.045966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.063237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f53dfd-5be2-436d-94c0-69a6bb097c98 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:53.070729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:53.071778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:53.073182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:53.078662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] PATH_INFO: `/v3/users/917aadf061bd40f8ac4ec2af8894f82d` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:53.078662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917aadf061bd40f8ac4ec2af8894f82d)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:53.078662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:53.119026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1072/2116] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:53.124119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87762f75-219f-4bcd-ad48-fd52357e5b30 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:53.155195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87762f75-219f-4bcd-ad48-fd52357e5b30 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:53.164652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:53.165727 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:53.167510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:53.167510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:53.170232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:53.170232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:53.170609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:53.185292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1073/2117] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:53.186289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:53.188191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.203082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d924-0951-447d-9b69-c8581a984c0f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:53.210582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:53.211590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:53.212373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:53.212613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] PATH_INFO: `/v3/projects/64b460fadf7a4e248f29bf520316bf1a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:53.214177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b460fadf7a4e248f29bf520316bf1a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:53.216321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:53.382674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917aadf061bd40f8ac4ec2af8894f82d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.396528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917aadf061bd40f8ac4ec2af8894f82d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.397430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917aadf061bd40f8ac4ec2af8894f82d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.425655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b460fadf7a4e248f29bf520316bf1a', 'request_id': 'req-c3b48879-c34c-4c1e-a0cf-c7681421951e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.434397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b460fadf7a4e248f29bf520316bf1a', 'request_id': 'req-c3b48879-c34c-4c1e-a0cf-c7681421951e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.543692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917aadf061bd40f8ac4ec2af8894f82d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.544479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917aadf061bd40f8ac4ec2af8894f82d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.568779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1045/2118] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:53 2022] DELETE /identity/v3/users/917aadf061bd40f8ac4ec2af8894f82d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:53.570603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:53.575507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.640507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b460fadf7a4e248f29bf520316bf1a', 'request_id': 'req-c3b48879-c34c-4c1e-a0cf-c7681421951e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.699054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] The token cache is being invalidate because project 64b460fadf7a4e248f29bf520316bf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:53.704356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.706086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:53.711309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1074/2119] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:53 2022] DELETE /identity/v3/projects/64b460fadf7a4e248f29bf520316bf1a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:53.716679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:53.723674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.729536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9829cc-e8b5-4aed-a205-069ed13a2b48 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:53.765552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:53.779588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:53.779991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:53.780284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:53.799588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.893640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b48879-c34c-4c1e-a0cf-c7681421951e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:53.979838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:53.984501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:53.999069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1651-5599-4b39-9bc1-21135c232445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:53.999703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1651-5599-4b39-9bc1-21135c232445 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:53.999982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1651-5599-4b39-9bc1-21135c232445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.000256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1651-5599-4b39-9bc1-21135c232445 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.001141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd1651-5599-4b39-9bc1-21135c232445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.008861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1046/2120] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:54.011213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:54.017437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:54.018227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd1651-5599-4b39-9bc1-21135c232445 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:54.061127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483512-6245-4fac-9b9b-62167d47f9e7 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:54.077972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:54.078666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.079451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.079910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] PATH_INFO: `/v3/projects/1f0d12683dab46edb0295fe820e6f162` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.082418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0d12683dab46edb0295fe820e6f162)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.087006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:54.225903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1075/2121] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:53 2022] POST /identity/v3/projects => generated 363 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:54.227331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2d03-4c76-4674-b2ab-724902cdbb95 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.227842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2d03-4c76-4674-b2ab-724902cdbb95 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.227949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2d03-4c76-4674-b2ab-724902cdbb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.274535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d92b2d03-4c76-4674-b2ab-724902cdbb95 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:54.276821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d92b2d03-4c76-4674-b2ab-724902cdbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:54.315920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0d12683dab46edb0295fe820e6f162', 'request_id': 'req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.331934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0d12683dab46edb0295fe820e6f162', 'request_id': 'req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.434792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0d12683dab46edb0295fe820e6f162', 'request_id': 'req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.456232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] The token cache is being invalidate because project 1f0d12683dab46edb0295fe820e6f162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:54.456971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.457149 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1076/2122] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:54.458126 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2d03-4c76-4674-b2ab-724902cdbb95 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:54.458268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4e9024fe-b328-4fbd-97de-bf8d8d21ef4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.464294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1047/2123] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:54 2022] DELETE /identity/v3/projects/1f0d12683dab46edb0295fe820e6f162 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:54.464962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.465434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.465936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.470434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2d03-4c76-4674-b2ab-724902cdbb95 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:54.476807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:54.477747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.478178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.479283 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.480443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.482980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:54.507359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:54.508719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:54.518370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1048/2124] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:54.519215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:54.520890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:54.535762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131bc41-23f8-45fb-a9e6-99145021cb44 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:54.543524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:54.545127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.545127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.545483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] PATH_INFO: `/v3/users/f978a5cba7184c95a2de2268a1653848` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.547433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f978a5cba7184c95a2de2268a1653848)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.550012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:54.642711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1077/2125] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:54 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:54.643778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:54.659339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71e79-138b-4334-b579-f9ad74a500e1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:54.686650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:54.689977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.691120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.691460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.693266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:54.693640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.697719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:54.717656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1078/2126] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:54.718713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:54.720876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:54.740440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8c6d-96c4-4ad6-a8bc-a6a8db08bc66 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:54.747773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:54.748621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.749223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.749528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] PATH_INFO: `/v3/projects/df824aa6d5a44a4f89b827b83a653136` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.751592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df824aa6d5a44a4f89b827b83a653136)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.754573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:54.755510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:54.818074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f978a5cba7184c95a2de2268a1653848'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.833195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f978a5cba7184c95a2de2268a1653848'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.833868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f978a5cba7184c95a2de2268a1653848'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.067196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df824aa6d5a44a4f89b827b83a653136', 'request_id': 'req-afaa9fb6-a2c9-4387-a532-635e39b0e238'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.075649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df824aa6d5a44a4f89b827b83a653136', 'request_id': 'req-afaa9fb6-a2c9-4387-a532-635e39b0e238'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.079880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f978a5cba7184c95a2de2268a1653848'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.080515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f978a5cba7184c95a2de2268a1653848'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.103146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1049/2127] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:54 2022] DELETE /identity/v3/users/f978a5cba7184c95a2de2268a1653848 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:55.104436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.105922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:55.205880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df824aa6d5a44a4f89b827b83a653136', 'request_id': 'req-afaa9fb6-a2c9-4387-a532-635e39b0e238'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.223234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] The token cache is being invalidate because project df824aa6d5a44a4f89b827b83a653136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:55.223542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.224209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.225766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1079/2128] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:54 2022] DELETE /identity/v3/projects/df824aa6d5a44a4f89b827b83a653136 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:55.228860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.231159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8cd35-d30e-4b44-942d-5a0a2e64a0ea admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:55.231753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:55.239229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:55.240323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:55.241467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:55.241979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:55.242999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:55.247814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:55.260573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:55.273384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1050/2129] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:55.278368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.280141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:55.318828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a194e08-f465-485a-9c3f-65281d980754 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:55.318828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:55.318828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:55.318828 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:55.319169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] PATH_INFO: `/v3/users/4e2ef147802b4dd6900dd85a96e1ae89` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:55.319169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2ef147802b4dd6900dd85a96e1ae89)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:55.321794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:55.386354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa9fb6-a2c9-4387-a532-635e39b0e238 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:55.392866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:55.393746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:55.394103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:55.394794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:55.395181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:55.397535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:55.583380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1080/2130] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:55 2022] POST /identity/v3/projects => generated 387 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:55.584620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.587130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:55.678468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bdc7a-1d4c-444e-b319-4e560eb6837a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:55.678468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:55.678468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:55.678468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:55.679431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:55.680343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:55.684164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:55.698157 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1081/2131] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:55.699606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.710468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2ef147802b4dd6900dd85a96e1ae89'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.712274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bd2f4-5225-4c83-ba88-61ee5c2c714e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:55.721144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:55.722225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:55.722942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:55.723491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:55.724483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:55.726904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:55.738966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2ef147802b4dd6900dd85a96e1ae89'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.740799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2ef147802b4dd6900dd85a96e1ae89'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.919755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2ef147802b4dd6900dd85a96e1ae89'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.920452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2ef147802b4dd6900dd85a96e1ae89'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.928083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1082/2132] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:55 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:55.928911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.934620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:55.946426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1051/2133] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:55 2022] DELETE /identity/v3/users/4e2ef147802b4dd6900dd85a96e1ae89 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:55.947857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.962131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:55.976216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d1b9e-25ae-4e06-b014-13281e022f54 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:56.092921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faa717-02bc-413b-94f0-d9cb53b2e2cb admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:56.122820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:56.123024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:56.123153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.123153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.123153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] PATH_INFO: `/v3/projects/2dc63996851a44c1b8b637b76a04a769/users/6d51954afab44a2f88474817ebed604b/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.123503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.123503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.124373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] PATH_INFO: `/v3/projects/8a4b081090ff4e4fa483f60f5cdd1ace` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.127784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4b081090ff4e4fa483f60f5cdd1ace)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:56.132720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:56.155468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc63996851a44c1b8b637b76a04a769, user_id=6d51954afab44a2f88474817ebed604b, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:56.162965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:56.341527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1083/2134] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:55 2022] PUT /identity/v3/projects/2dc63996851a44c1b8b637b76a04a769/users/6d51954afab44a2f88474817ebed604b/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:56.342772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:56.344756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:56.383680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4b081090ff4e4fa483f60f5cdd1ace', 'request_id': 'req-a7300f95-ab09-4c6f-901f-5607ef4c433b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.392863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4b081090ff4e4fa483f60f5cdd1ace', 'request_id': 'req-a7300f95-ab09-4c6f-901f-5607ef4c433b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.542452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8983-457a-49d4-b6b3-4600cb4b83c3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:56.577668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4b081090ff4e4fa483f60f5cdd1ace', 'request_id': 'req-a7300f95-ab09-4c6f-901f-5607ef4c433b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.603956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] The token cache is being invalidate because project 8a4b081090ff4e4fa483f60f5cdd1ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:56.605932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.608537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7300f95-ab09-4c6f-901f-5607ef4c433b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.616975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1052/2135] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:55 2022] DELETE /identity/v3/projects/8a4b081090ff4e4fa483f60f5cdd1ace => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:56.622610 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadc2f-7502-4243-91a2-8899792f5058 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.622924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadc2f-7502-4243-91a2-8899792f5058 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.624352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadc2f-7502-4243-91a2-8899792f5058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.747152 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6feadc2f-7502-4243-91a2-8899792f5058 None None] MFA Rules not processed for user `6d51954afab44a2f88474817ebed604b`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:56.748646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6feadc2f-7502-4243-91a2-8899792f5058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:56.760736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cad716-29e0-4e4a-913b-778a7fba8f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:56.767333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cad716-29e0-4e4a-913b-778a7fba8f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.767816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cad716-29e0-4e4a-913b-778a7fba8f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.768838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cad716-29e0-4e4a-913b-778a7fba8f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.770300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cad716-29e0-4e4a-913b-778a7fba8f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:56.773553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cad716-29e0-4e4a-913b-778a7fba8f73 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:56.810404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1084/2136] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:56.815030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.818366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.819347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.870227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:56.873529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:56.891867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1085/2137] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:56.892813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:56.896011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:56.906671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1053/2138] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:56.906671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.906671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.906671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.915620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c172b-5acf-4e51-bbb6-d5f4db4e0879 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:56.925473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:56.926552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.927131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.928798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.929109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:56.932768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:56.974569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1086/2139] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:56.975642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:56.977794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:56.985500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:56.999163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.011994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3921-8d4d-4d20-80d2-a6a8a704184a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.026771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.027427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.027709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.027986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.028640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.030716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.045709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1054/2140] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:57.048842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.058412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.108155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb093744-c806-46d2-b91e-0307f4d6b424 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.119595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.120432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.120835 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.121184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] PATH_INFO: `/v3/projects/1c6e19fe290748f298bab88499f40098` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.122797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6e19fe290748f298bab88499f40098)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.125001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.174074 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1087/2141] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:57.177544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.276506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb327f-e28e-4366-a9b9-1191db4ffad4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.289107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.289843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.290121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.290459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] PATH_INFO: `/v3/projects/7052604e37f4405bb5ccf8ffff694369/users/3355014e725048949595575341c69c9c/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.302224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6e19fe290748f298bab88499f40098', 'request_id': 'req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:57.310413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6e19fe290748f298bab88499f40098', 'request_id': 'req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:57.317225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7052604e37f4405bb5ccf8ffff694369, user_id=3355014e725048949595575341c69c9c, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.321109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.427971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6e19fe290748f298bab88499f40098', 'request_id': 'req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:57.438395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1088/2142] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:57 2022] PUT /identity/v3/projects/7052604e37f4405bb5ccf8ffff694369/users/3355014e725048949595575341c69c9c/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:57.440574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.441745 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] The token cache is being invalidate because project 1c6e19fe290748f298bab88499f40098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:57.442062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:57.442764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4d2aa28e-2d95-4596-b90b-50e0dee6a89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:57.444429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1055/2143] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:57 2022] DELETE /identity/v3/projects/1c6e19fe290748f298bab88499f40098 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:57.446088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ca2e-177e-4100-a3a1-52ff166bbb15 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.446374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ca2e-177e-4100-a3a1-52ff166bbb15 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.449309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ca2e-177e-4100-a3a1-52ff166bbb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.457696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:57.487130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d1e1ca2e-177e-4100-a3a1-52ff166bbb15 None None] MFA Rules not processed for user `cfa791db71dd4345ba4b5988a33ec533`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:57.488397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d1e1ca2e-177e-4100-a3a1-52ff166bbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.521916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b883b-793d-45a7-8a8a-a4053e5b2a20 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.527923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.528670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.530882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.531222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.532125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:57.532445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.534103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.547812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1089/2144] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:57.553544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.555602 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.576066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b69bc8-c693-48d4-8f06-a0be7ab6576a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.584092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.584738 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.585050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.585323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.585962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.588530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.594781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:57.600810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1056/2145] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:57.603839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179793bb-6fa1-4db5-98d8-cb420b408a3c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.604540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179793bb-6fa1-4db5-98d8-cb420b408a3c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.605125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179793bb-6fa1-4db5-98d8-cb420b408a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.651696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-179793bb-6fa1-4db5-98d8-cb420b408a3c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:57.653728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-179793bb-6fa1-4db5-98d8-cb420b408a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.682584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1057/2146] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:57.684743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.685040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.685325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.708888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:57.710885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.721500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1058/2147] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:57.722358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.727115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1090/2148] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:57.727874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.729022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.734822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.745083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70628-b95a-46a2-8607-7e9bb3c0be84 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.752306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.753362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.753722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.754078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.754842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.756866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.759362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20219f87-dac8-4f9b-96d0-582163a7b998 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.770178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.771228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.771369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.771782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.772683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.774693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.922204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1059/2149] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:57.922204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.925378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.942507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1091/2150] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:57.942507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.009435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e863ea-fee3-4b5b-8d81-2d1969e6a5a8 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.046824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2259c85-5f09-431b-a657-08fe075f5b5d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.055833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201400-5e43-45a7-8fa5-3562f7a6f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.057450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201400-5e43-45a7-8fa5-3562f7a6f59b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.057959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201400-5e43-45a7-8fa5-3562f7a6f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.058467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201400-5e43-45a7-8fa5-3562f7a6f59b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.059736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201400-5e43-45a7-8fa5-3562f7a6f59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.063146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201400-5e43-45a7-8fa5-3562f7a6f59b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.074276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.074995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.075256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.075520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.081928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1092/2151] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:58.081928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ca66f-11d5-4249-b2b2-806a3d009c92 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.081928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ca66f-11d5-4249-b2b2-806a3d009c92 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.081928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ca66f-11d5-4249-b2b2-806a3d009c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.091626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.093479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.105128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1060/2152] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:58.106334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.106922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d82ca66f-11d5-4249-b2b2-806a3d009c92 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:58.108142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d82ca66f-11d5-4249-b2b2-806a3d009c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:58.117152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1093/2153] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:58.117416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d520a-b755-4563-bba1-4298869c7b25 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.118150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ca66f-11d5-4249-b2b2-806a3d009c92 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.136097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.144988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.144988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.144988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.144988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.144988 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.154910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ca66f-11d5-4249-b2b2-806a3d009c92 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.168818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.168818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.168818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.169954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.171030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.174556 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.272775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1061/2154] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:58 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:58.272775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.286810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f051fc-2712-49fb-a9bf-d452c016db68 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.308523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1094/2155] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:58 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:58.308523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.308965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.308965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.311774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.312617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] PATH_INFO: `/v3/projects/1eb8c4ce64244b5d9c2bb4a83432016e/users/dd65d6d1450c42ee9709ba5c2438c93c/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.333034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2c34c-e3b7-4752-951f-33fe0687ce49 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.345335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.346411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.355953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.356661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.363855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:58.363855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.364151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8c4ce64244b5d9c2bb4a83432016e, user_id=dd65d6d1450c42ee9709ba5c2438c93c, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.365899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.378412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.414361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1095/2156] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:58.414913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.439323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b346c1-335d-4b31-9ce6-92200cd506f7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.440301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.441078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.441450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.441826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.442608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.446247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.469004 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1096/2157] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:58.470288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.486680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f98d-d647-40aa-8e7e-c29e213ec035 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.493136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.493846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.494226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.494888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.495858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.497705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.516034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1062/2158] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:58 2022] PUT /identity/v3/projects/1eb8c4ce64244b5d9c2bb4a83432016e/users/dd65d6d1450c42ee9709ba5c2438c93c/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:58.518292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.521747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1097/2159] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:58.523081 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.537265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b35f-35db-4518-ac2d-5aa737f55f07 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.643992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8848391-9fa8-4794-bb85-7eda4c874df0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.665589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.665589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.665589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.667914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.669396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.674150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.707508 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.708732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.709167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.709627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.710439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.713587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.729720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1098/2160] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:58.730737 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.746402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8979e5-f8f1-4374-825b-dea88fca5e5a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.753768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.754514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.754925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.755323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.756145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.758062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.774783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1099/2161] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:58.774783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.788748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417815-3fb6-4d77-8b8d-8f8420de0895 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.795892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.797013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.797357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.797801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] PATH_INFO: `/v3/projects/8bdd361c918c43288eca38f58c991df2/users/40a9c3267aa1411fb904384610597e2f/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.819698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdd361c918c43288eca38f58c991df2, user_id=40a9c3267aa1411fb904384610597e2f, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.823021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.825692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1063/2162] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:58 2022] POST /identity/v3/projects => generated 383 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:58.826877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.928779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4b2aa-2175-4a66-a690-33d98e5e54ac admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.939672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.941363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.948300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.948300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] PATH_INFO: `/v3/projects/3299d1f6b79c478dbe3866e572d7775e/users/b56040e6588240c7ade0e0f520ff95cf/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.971314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3299d1f6b79c478dbe3866e572d7775e, user_id=b56040e6588240c7ade0e0f520ff95cf, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.975675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.988930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1100/2163] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:58 2022] PUT /identity/v3/projects/8bdd361c918c43288eca38f58c991df2/users/40a9c3267aa1411fb904384610597e2f/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:58.990432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.099420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ab861-0ced-4371-8ef4-cf78137e624e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.104263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.104911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.105189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.105465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] PATH_INFO: `/v3/projects/1eb8c4ce64244b5d9c2bb4a83432016e/users/dd65d6d1450c42ee9709ba5c2438c93c/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.107483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb8c4ce64244b5d9c2bb4a83432016e, user_id=dd65d6d1450c42ee9709ba5c2438c93c, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.110166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.128644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1101/2164] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:58 2022] PUT /identity/v3/projects/1eb8c4ce64244b5d9c2bb4a83432016e/users/dd65d6d1450c42ee9709ba5c2438c93c/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:59.129686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.164560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1064/2165] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:58 2022] PUT /identity/v3/projects/3299d1f6b79c478dbe3866e572d7775e/users/b56040e6588240c7ade0e0f520ff95cf/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:59.166697 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.247349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef824-ec2d-4441-a670-27ea4270f22b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.251678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86243-ed90-41d2-be4a-8c6bab555c37 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.255190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c5023-3609-4cd8-8058-1511531177f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.255190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c5023-3609-4cd8-8058-1511531177f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.255190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c5023-3609-4cd8-8058-1511531177f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.255190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c5023-3609-4cd8-8058-1511531177f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.256352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c5023-3609-4cd8-8058-1511531177f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.257371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c5023-3609-4cd8-8058-1511531177f6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.261202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42476857-d247-4a27-ba9f-014a9d7a949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.261743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476857-d247-4a27-ba9f-014a9d7a949a admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.262066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476857-d247-4a27-ba9f-014a9d7a949a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.262318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476857-d247-4a27-ba9f-014a9d7a949a admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.263033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42476857-d247-4a27-ba9f-014a9d7a949a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.264664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42476857-d247-4a27-ba9f-014a9d7a949a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.282060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1065/2166] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:59.283723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74663b-bbf3-4237-b8bf-0363a0af8f60 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.284158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74663b-bbf3-4237-b8bf-0363a0af8f60 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.284603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74663b-bbf3-4237-b8bf-0363a0af8f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.328689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-8e74663b-bbf3-4237-b8bf-0363a0af8f60 None None] MFA Rules not processed for user `dd65d6d1450c42ee9709ba5c2438c93c`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:59.329926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8e74663b-bbf3-4237-b8bf-0363a0af8f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:59.381870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1102/2167] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:59 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:59.386790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b457bf-70ee-4102-b396-2b2b45f6503c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.387123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b457bf-70ee-4102-b396-2b2b45f6503c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.387354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b457bf-70ee-4102-b396-2b2b45f6503c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.439637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-01b457bf-70ee-4102-b396-2b2b45f6503c None None] MFA Rules not processed for user `b56040e6588240c7ade0e0f520ff95cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:59.441535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-01b457bf-70ee-4102-b396-2b2b45f6503c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:59.495674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1066/2168] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:59.496550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74663b-bbf3-4237-b8bf-0363a0af8f60 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.528362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74663b-bbf3-4237-b8bf-0363a0af8f60 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.538504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.545138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.545138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.545138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] PATH_INFO: `/v3/projects/8bdd361c918c43288eca38f58c991df2/users/40a9c3267aa1411fb904384610597e2f/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.545718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdd361c918c43288eca38f58c991df2, user_id=40a9c3267aa1411fb904384610597e2f, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.548574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.559934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1103/2169] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:22:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:59.559934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b457bf-70ee-4102-b396-2b2b45f6503c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.567439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1067/2170] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:59 2022] PUT /identity/v3/projects/8bdd361c918c43288eca38f58c991df2/users/40a9c3267aa1411fb904384610597e2f/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:59.568684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.580079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:59.587362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b457bf-70ee-4102-b396-2b2b45f6503c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.688426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.689753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.690045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.690328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.691050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.693014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.711293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd045b-83b3-4a83-a2ac-4011c4f84a23 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.712433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1104/2171] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:59.714684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.722012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.723244 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.723761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.724036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.779856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10331e5-4a21-47b0-bd9a-87fef1b1d6d6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.795409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.796478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.797444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.797885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.799890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.802375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.848237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.850166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.864877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1068/2172] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:59.865459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.897241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25008636-d776-4973-8bd1-a6891e3751c2 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.912951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.913599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.913885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.914161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.914867 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.918422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.945898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1069/2173] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:59.952076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.974377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5b92-5c4c-479c-a05b-441cf695b399 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.988567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb2019-ebbb-4b8a-b941-9f797042744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.990584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb2019-ebbb-4b8a-b941-9f797042744b admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.991856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb2019-ebbb-4b8a-b941-9f797042744b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.992813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb2019-ebbb-4b8a-b941-9f797042744b admin admin] PATH_INFO: `/v3/projects/6f2054a9c9ff437c8aceef06d0043526/users/d8e620b4ca454bc5a6a19ae55138d861/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.005185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1105/2174] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:59 2022] POST /identity/v3/projects => generated 383 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:00.009448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:00.027583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb2019-ebbb-4b8a-b941-9f797042744b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2054a9c9ff437c8aceef06d0043526, user_id=d8e620b4ca454bc5a6a19ae55138d861, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.033080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb2019-ebbb-4b8a-b941-9f797042744b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.114319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226085b-9a1e-4060-a389-4c2b6153404b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:00.120000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:00.120844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.121128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.121395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.122059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.124089 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.215455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1070/2175] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:59 2022] PUT /identity/v3/projects/6f2054a9c9ff437c8aceef06d0043526/users/d8e620b4ca454bc5a6a19ae55138d861/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:00.217857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25add3-93eb-4fac-bcf4-fbdc763590a4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.218289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25add3-93eb-4fac-bcf4-fbdc763590a4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.223348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25add3-93eb-4fac-bcf4-fbdc763590a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.272382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1106/2176] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:00 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:00.272382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:00.274925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9f25add3-93eb-4fac-bcf4-fbdc763590a4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:00.276364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9f25add3-93eb-4fac-bcf4-fbdc763590a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:00.366786 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6c029-b14a-4eee-b8cf-daf72a9b40c0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:00.381318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1071/2177] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:00.384090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25add3-93eb-4fac-bcf4-fbdc763590a4 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:00.404869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25add3-93eb-4fac-bcf4-fbdc763590a4 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:00.412561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:00.414105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.414467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.419551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.419551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.419551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.435667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1072/2178] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:00.435667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:00.459439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:00.459439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.459439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.459439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.462369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:00.560040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a663-d525-4328-9696-8f32b5a55c05 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:00.572909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:00.573016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.573445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.573886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.601795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.607615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.620432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.622371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.633393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1107/2179] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:00.634440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:00.635647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1073/2180] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:00.683873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff901669-561f-4237-ae86-096a25a84aa2 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:00.710693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3b3f9-8c60-4136-aaa8-b5bfd5ec01c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:00.711643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3b3f9-8c60-4136-aaa8-b5bfd5ec01c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.711925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3b3f9-8c60-4136-aaa8-b5bfd5ec01c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.712202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3b3f9-8c60-4136-aaa8-b5bfd5ec01c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.713394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3b3f9-8c60-4136-aaa8-b5bfd5ec01c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.716105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3b3f9-8c60-4136-aaa8-b5bfd5ec01c1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.748899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:00.749923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1108/2181] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:00.776708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725cb76-9da0-4738-a8b2-0f44078580a4 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:00.783627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:00.784616 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.784932 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.785243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] PATH_INFO: `/v3/projects/928642f3b99e4984817d26cf3d438dc4/users/5f62710e4e0545d1a6f14c4182c5f1ed/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.807414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928642f3b99e4984817d26cf3d438dc4, user_id=5f62710e4e0545d1a6f14c4182c5f1ed, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.810187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.905057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1074/2182] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:00 2022] PUT /identity/v3/projects/928642f3b99e4984817d26cf3d438dc4/users/5f62710e4e0545d1a6f14c4182c5f1ed/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:00.916652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ecec-4635-4646-a9d7-121719aef3fa None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:00.917516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ecec-4635-4646-a9d7-121719aef3fa None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:00.917964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ecec-4635-4646-a9d7-121719aef3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.975919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-93e7ecec-4635-4646-a9d7-121719aef3fa None None] MFA Rules not processed for user `5f62710e4e0545d1a6f14c4182c5f1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:00.978164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-93e7ecec-4635-4646-a9d7-121719aef3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:01.152385 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1109/2183] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:01.157463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:01.266596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9611-e49e-4c6a-af53-97c48e29a3e5 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:01.272027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:01.272854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:01.273230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:01.273574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:01.274326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:01.277473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:01.501737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1075/2184] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:01 2022] POST /identity/v3/projects => generated 383 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:01.507782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7ecec-4635-4646-a9d7-121719aef3fa None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:01.522313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7ecec-4635-4646-a9d7-121719aef3fa None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:01.531852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:01.687082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:01.689163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:01.703085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:01.703085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:01.703085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:01.703085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:01.703085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:01.954018 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1110/2185] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:01 2022] POST /identity/v3/users => generated 298 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:01.959598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:01.976179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5662863-7ba6-40b5-9dd6-df6f0872584c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:01.988823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:01.989634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:01.990216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:01.991398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:01.994394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:01.996802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:02.032570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1076/2186] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:02.039053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:02.056171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4e667-e337-4939-8921-ffdf64435d2b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:02.063909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:02.065394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:02.065593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:02.065770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] PATH_INFO: `/v3/projects/d6ffff243c9543aea6765ce1847951d9/users/99ee397113a84dae8b9ae916d029b5ad/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:02.102526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ffff243c9543aea6765ce1847951d9, user_id=99ee397113a84dae8b9ae916d029b5ad, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:02.106306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:02.199007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1111/2187] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:02 2022] PUT /identity/v3/projects/d6ffff243c9543aea6765ce1847951d9/users/99ee397113a84dae8b9ae916d029b5ad/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:02.200145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:02.215881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d96f-1067-4776-b76f-705c702de145 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:02.367600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42623963-dc53-4a88-96c7-77ac501ce152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:02.368690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623963-dc53-4a88-96c7-77ac501ce152 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:02.369400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623963-dc53-4a88-96c7-77ac501ce152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:02.369779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623963-dc53-4a88-96c7-77ac501ce152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:02.370849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42623963-dc53-4a88-96c7-77ac501ce152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:02.372962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42623963-dc53-4a88-96c7-77ac501ce152 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:02.408845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1077/2188] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:02.410052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:02.425435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d177f0d-1199-4819-b6f4-dc3ae16314ec admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:02.439928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:02.440634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:02.440918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:02.441193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] PATH_INFO: `/v3/projects/d6ffff243c9543aea6765ce1847951d9/users/99ee397113a84dae8b9ae916d029b5ad/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:02.446814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ffff243c9543aea6765ce1847951d9, user_id=99ee397113a84dae8b9ae916d029b5ad, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:02.449932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:02.476049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1112/2189] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:02 2022] PUT /identity/v3/projects/d6ffff243c9543aea6765ce1847951d9/users/99ee397113a84dae8b9ae916d029b5ad/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:02.490862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a6b4-98a3-431d-8ce5-6debdf5654d9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:02.491422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a6b4-98a3-431d-8ce5-6debdf5654d9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:02.491966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a6b4-98a3-431d-8ce5-6debdf5654d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:02.598386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2f30a6b4-98a3-431d-8ce5-6debdf5654d9 None None] MFA Rules not processed for user `99ee397113a84dae8b9ae916d029b5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:02.601367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2f30a6b4-98a3-431d-8ce5-6debdf5654d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:02.818383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1078/2190] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:02.830890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:02.833349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:02.946042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3841283-53a5-42a2-ac3e-6e8aab95c7dc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:02.956233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:02.957055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:02.957342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:02.957614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:03.044305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:03.045986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:03.062662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1113/2191] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:06.028477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:06.099315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:08.113779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a6b4-98a3-431d-8ce5-6debdf5654d9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:08.125468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a6b4-98a3-431d-8ce5-6debdf5654d9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:08.137413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4912cd-d292-4b76-ad69-f223679de8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:08.138881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4912cd-d292-4b76-ad69-f223679de8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:08.139348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4912cd-d292-4b76-ad69-f223679de8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:08.139835 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4912cd-d292-4b76-ad69-f223679de8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:08.296447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4912cd-d292-4b76-ad69-f223679de8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:08.298949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4912cd-d292-4b76-ad69-f223679de8b2 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:08.317509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1079/2192] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:08.925928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:09.169685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:11.742375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:11.773378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4825650-aecb-4315-84a5-32ecddcb6746 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:11.787952 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0085f7c-9182-4dd0-a273-f800293209ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:11.803596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0085f7c-9182-4dd0-a273-f800293209ea service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.803596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0085f7c-9182-4dd0-a273-f800293209ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.803596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0085f7c-9182-4dd0-a273-f800293209ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.843254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0085f7c-9182-4dd0-a273-f800293209ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:11.850977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0085f7c-9182-4dd0-a273-f800293209ea service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:11.889419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1114/2193] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:12.359647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:12.453449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.454028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.454028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.548836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192422e-f02f-4b4a-ad14-b670cad31bf0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.549241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192422e-f02f-4b4a-ad14-b670cad31bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.549533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192422e-f02f-4b4a-ad14-b670cad31bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.598116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] MFA Rules not processed for user `3355014e725048949595575341c69c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:12.605683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:12.669605 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d192422e-f02f-4b4a-ad14-b670cad31bf0 None None] MFA Rules not processed for user `d8e620b4ca454bc5a6a19ae55138d861`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:12.671173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d192422e-f02f-4b4a-ad14-b670cad31bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:12.770188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1080/2194] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:12.785507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1115/2195] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:12.799313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:12.799313 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:12.803689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192422e-f02f-4b4a-ad14-b670cad31bf0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:12.945056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61c05d-57f2-444e-bd93-676e70b20b15 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:12.958564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:12.959728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.960726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.961039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.976638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192422e-f02f-4b4a-ad14-b670cad31bf0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:12.987171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:12.988313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:12.989234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.989676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.990129 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.990980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:12.991105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:12.997100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:13.005387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1081/2196] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:13.180519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1116/2197] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:12 2022] POST /identity/v3/projects => generated 383 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:13.185409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:13.207704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f059ee-9fb9-42a1-815d-7c2a9eaed6a4 service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:13.344800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:13.345583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:13.345872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:13.346200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:13.346969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:13.352262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:13.523821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1082/2198] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:13 2022] POST /identity/v3/users => generated 298 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:13.528531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:13.556738 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ec1dd-acf1-4e0f-a90d-e591b3feca57 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:13.575931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:13.578037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:13.579484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:13.580058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:13.580986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:13.586781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:13.613715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:13.623919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1117/2199] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:13.626981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfaa94-784d-462d-ada8-5782bdac46b7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:13.641050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:13.642027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:13.642376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:13.647405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] PATH_INFO: `/v3/projects/d4a1b62c333644edb4ab576c7c3f530c/users/3295a79391ea466d9d8b9c41a806fbf3/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:13.668631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a1b62c333644edb4ab576c7c3f530c, user_id=3295a79391ea466d9d8b9c41a806fbf3, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:13.694184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:13.771893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:13.900424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1083/2200] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:13 2022] PUT /identity/v3/projects/d4a1b62c333644edb4ab576c7c3f530c/users/3295a79391ea466d9d8b9c41a806fbf3/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:13.905942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:13.926228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30176b-7480-4569-946c-cf15dc1b1a86 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:14.119966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63bd9b-273e-421e-b5f7-6463f1b84ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:14.121670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bd9b-273e-421e-b5f7-6463f1b84ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:14.122259 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bd9b-273e-421e-b5f7-6463f1b84ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:14.122842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bd9b-273e-421e-b5f7-6463f1b84ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:14.123902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63bd9b-273e-421e-b5f7-6463f1b84ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:14.126338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63bd9b-273e-421e-b5f7-6463f1b84ba8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:14.181594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:14.189672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1118/2201] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:14.199286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4fa99-cb86-4d81-b0b6-b99dc16ed8fb admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:14.223357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:14.224335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:14.224790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:14.225283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] PATH_INFO: `/v3/projects/d4a1b62c333644edb4ab576c7c3f530c/users/3295a79391ea466d9d8b9c41a806fbf3/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:14.231272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a1b62c333644edb4ab576c7c3f530c, user_id=3295a79391ea466d9d8b9c41a806fbf3, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:14.239404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:14.319249 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1084/2202] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:14 2022] PUT /identity/v3/projects/d4a1b62c333644edb4ab576c7c3f530c/users/3295a79391ea466d9d8b9c41a806fbf3/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:15.415871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060d77-ce2f-449c-a562-5d7e078440ca None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.417410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060d77-ce2f-449c-a562-5d7e078440ca None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.417410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060d77-ce2f-449c-a562-5d7e078440ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.461192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f7060d77-ce2f-449c-a562-5d7e078440ca None None] MFA Rules not processed for user `40a9c3267aa1411fb904384610597e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:15.464303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f7060d77-ce2f-449c-a562-5d7e078440ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:15.606935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1119/2203] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:15.633615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:15.661559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:15.858675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96c00-0732-44d9-9a4a-6e0c6a5a3ce7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:15.865119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feec89-d437-473b-9ca5-75e66229d95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:15.865753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feec89-d437-473b-9ca5-75e66229d95a service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.866038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feec89-d437-473b-9ca5-75e66229d95a service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.866316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feec89-d437-473b-9ca5-75e66229d95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.955694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feec89-d437-473b-9ca5-75e66229d95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:15.975553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feec89-d437-473b-9ca5-75e66229d95a service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:15.990937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1085/2204] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:16.788248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:17.861288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:18.109771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:20.145222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98aa39-b801-4996-a80f-de73f7f57b0e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:20.145903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98aa39-b801-4996-a80f-de73f7f57b0e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:20.153032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98aa39-b801-4996-a80f-de73f7f57b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:20.248699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bc98aa39-b801-4996-a80f-de73f7f57b0e None None] MFA Rules not processed for user `3355014e725048949595575341c69c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:20.256388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bc98aa39-b801-4996-a80f-de73f7f57b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:20.329609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:20.657232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1120/2205] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:20.727255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:22.749782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3abe6c-48de-4e1f-ab39-ae09c62b6cf6 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:22.750604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3abe6c-48de-4e1f-ab39-ae09c62b6cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:22.750604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3abe6c-48de-4e1f-ab39-ae09c62b6cf6 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:22.751792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1086/2206] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 17 20:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:23:22.776205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1532d33-3f25-4384-a74f-e18ba3e6c863 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:22.777057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1532d33-3f25-4384-a74f-e18ba3e6c863 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:22.777215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1532d33-3f25-4384-a74f-e18ba3e6c863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:22.848257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a1532d33-3f25-4384-a74f-e18ba3e6c863 None None] MFA Rules not processed for user `765ee8241c4e448eb999016b17132e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:22.853851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a1532d33-3f25-4384-a74f-e18ba3e6c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:22.908448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:23.067433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3abe6c-48de-4e1f-ab39-ae09c62b6cf6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:23.215859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1121/2207] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:23:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:23.238655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1532d33-3f25-4384-a74f-e18ba3e6c863 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:23.254908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3abe6c-48de-4e1f-ab39-ae09c62b6cf6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:23.263131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:23.265968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:23.265968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:23.265968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] PATH_INFO: `/v3/users/b56040e6588240c7ade0e0f520ff95cf` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:23.267847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56040e6588240c7ade0e0f520ff95cf)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:23.270605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:23.287409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1532d33-3f25-4384-a74f-e18ba3e6c863 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:23.296531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3248e8a-c7fa-49f0-9e5d-ae01a845f5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:23.297197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3248e8a-c7fa-49f0-9e5d-ae01a845f5ec service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:23.297491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3248e8a-c7fa-49f0-9e5d-ae01a845f5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:23.297775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3248e8a-c7fa-49f0-9e5d-ae01a845f5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:23.333718 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3248e8a-c7fa-49f0-9e5d-ae01a845f5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:23.350524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3248e8a-c7fa-49f0-9e5d-ae01a845f5ec service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:23.368015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1122/2208] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:23.574049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56040e6588240c7ade0e0f520ff95cf'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:23.632978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56040e6588240c7ade0e0f520ff95cf'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:23.634153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56040e6588240c7ade0e0f520ff95cf'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:23.737880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56040e6588240c7ade0e0f520ff95cf'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:23.738886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56040e6588240c7ade0e0f520ff95cf'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:23.780676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1087/2209] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:23 2022] DELETE /identity/v3/users/b56040e6588240c7ade0e0f520ff95cf => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:23.787326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:23.789520 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:23.790305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:23.869431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:23.872330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:24.023639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1123/2210] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:24.041752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:24.043410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:24.136075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:24.139113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:24.179068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006a5c6-018c-4aca-bf09-fc55342be648 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:24.191601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:24.193076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.193748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.194258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] PATH_INFO: `/v3/users/6d51954afab44a2f88474817ebed604b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.196751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d51954afab44a2f88474817ebed604b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:24.201561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:24.252227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eef293-d6dc-4460-988a-d348f79279e7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:24.271583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326d964-c279-42d0-9a49-141453588a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:24.273010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d964-c279-42d0-9a49-141453588a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.273436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d964-c279-42d0-9a49-141453588a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.280709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d964-c279-42d0-9a49-141453588a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.312995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326d964-c279-42d0-9a49-141453588a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:24.320360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326d964-c279-42d0-9a49-141453588a06 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:24.350676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1088/2211] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:24.585255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d51954afab44a2f88474817ebed604b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:24.637373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d51954afab44a2f88474817ebed604b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:24.667834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d51954afab44a2f88474817ebed604b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:24.673302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d51954afab44a2f88474817ebed604b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:24.875415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1c0012d-72b0-4e61-9072-c378852437cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d51954afab44a2f88474817ebed604b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:24.905790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1124/2212] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:24 2022] DELETE /identity/v3/users/6d51954afab44a2f88474817ebed604b => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:24.911649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.912361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.913101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.916543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.917640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.920495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.969347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] MFA Rules not processed for user `cfa791db71dd4345ba4b5988a33ec533`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:24.976824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.054002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:25.058246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.264045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1125/2213] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:25.316218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:25.378337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1089/2214] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:25.403257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:25.405837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.626091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:25.627900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.637861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55feaf-5e79-4ae7-8900-a64c236d898a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:25.658302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:25.660366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.664579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.664579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.687163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a238cb2-3ab5-437c-9885-1b758694330d None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:25.690849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:25.694302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:25.735020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:25.744985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.744985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.744985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] PATH_INFO: `/v3/projects/3299d1f6b79c478dbe3866e572d7775e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.751300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3299d1f6b79c478dbe3866e572d7775e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:25.751673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1126/2215] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:25.764087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:26.089406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3299d1f6b79c478dbe3866e572d7775e', 'request_id': 'req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:26.102012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3299d1f6b79c478dbe3866e572d7775e', 'request_id': 'req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:26.178295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:26.250819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3299d1f6b79c478dbe3866e572d7775e', 'request_id': 'req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:26.269557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] The token cache is being invalidate because project 3299d1f6b79c478dbe3866e572d7775e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:26.270178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:26.271388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:26.277845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1090/2216] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:25 2022] DELETE /identity/v3/projects/3299d1f6b79c478dbe3866e572d7775e => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:26.279231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:26.314154 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f3c8-a2c9-4ca1-aff1-c84226a16b52 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:26.641339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:26.642388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:26.642674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:26.643332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] PATH_INFO: `/v3/users/5f62710e4e0545d1a6f14c4182c5f1ed` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:26.645669 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f62710e4e0545d1a6f14c4182c5f1ed)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:26.648008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:26.756847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:26.760460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:26.819820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15e05-049b-4032-8ee7-b5f3ebff4fa7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:26.850208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:26.853138 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:26.856582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:26.857118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] PATH_INFO: `/v3/projects/2dc63996851a44c1b8b637b76a04a769` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:26.863845 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc63996851a44c1b8b637b76a04a769)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:26.871885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:27.028885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f62710e4e0545d1a6f14c4182c5f1ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.070451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f62710e4e0545d1a6f14c4182c5f1ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.089675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f62710e4e0545d1a6f14c4182c5f1ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.091535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f62710e4e0545d1a6f14c4182c5f1ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.163949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc63996851a44c1b8b637b76a04a769', 'request_id': 'req-8200bc79-69ba-478e-b8e3-975011bd1fcd'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.173846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc63996851a44c1b8b637b76a04a769', 'request_id': 'req-8200bc79-69ba-478e-b8e3-975011bd1fcd'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.223027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f62710e4e0545d1a6f14c4182c5f1ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.230819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1127/2217] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:26 2022] DELETE /identity/v3/users/5f62710e4e0545d1a6f14c4182c5f1ed => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:27.404937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc63996851a44c1b8b637b76a04a769', 'request_id': 'req-8200bc79-69ba-478e-b8e3-975011bd1fcd'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.430952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] The token cache is being invalidate because project 2dc63996851a44c1b8b637b76a04a769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:27.431492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.432590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:27.439074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1091/2218] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:26 2022] DELETE /identity/v3/projects/2dc63996851a44c1b8b637b76a04a769 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:27.443419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:27.445583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:27.622041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef1cf-dbac-4b95-bca0-075829387d28 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:27.631204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:27.632722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:27.633467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:27.634275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] PATH_INFO: `/v3/users/dd65d6d1450c42ee9709ba5c2438c93c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:27.636959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd65d6d1450c42ee9709ba5c2438c93c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:27.644156 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:28.306833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd65d6d1450c42ee9709ba5c2438c93c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:28.353655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd65d6d1450c42ee9709ba5c2438c93c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:28.364814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd65d6d1450c42ee9709ba5c2438c93c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:28.365699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd65d6d1450c42ee9709ba5c2438c93c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:28.479906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd65d6d1450c42ee9709ba5c2438c93c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:28.497152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1128/2219] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:27 2022] DELETE /identity/v3/users/dd65d6d1450c42ee9709ba5c2438c93c => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:28.582955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:28.740390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:28.742612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:28.762884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:28.767416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:28.905712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bc2ba-1327-411c-ac73-1e1776c47fbb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:28.912456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:28.913204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:28.913912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:28.914552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] PATH_INFO: `/v3/users/28ce118c87904c0fb1ebb7789fce742f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:28.921871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ce118c87904c0fb1ebb7789fce742f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:28.924457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:28.933856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200bc79-69ba-478e-b8e3-975011bd1fcd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:28.967194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:28.973675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:28.973844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:28.974199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] PATH_INFO: `/v3/projects/928642f3b99e4984817d26cf3d438dc4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:28.976305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=928642f3b99e4984817d26cf3d438dc4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:28.979570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:29.247413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928642f3b99e4984817d26cf3d438dc4', 'request_id': 'req-6e2fbc5a-4f51-4e26-831b-743248366aff'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.269041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928642f3b99e4984817d26cf3d438dc4', 'request_id': 'req-6e2fbc5a-4f51-4e26-831b-743248366aff'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.405408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928642f3b99e4984817d26cf3d438dc4', 'request_id': 'req-6e2fbc5a-4f51-4e26-831b-743248366aff'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.416438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ce118c87904c0fb1ebb7789fce742f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.433123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] The token cache is being invalidate because project 928642f3b99e4984817d26cf3d438dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:29.435080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.444811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ce118c87904c0fb1ebb7789fce742f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.446012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.455638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ce118c87904c0fb1ebb7789fce742f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.456965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ce118c87904c0fb1ebb7789fce742f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.471299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1092/2220] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:28 2022] DELETE /identity/v3/projects/928642f3b99e4984817d26cf3d438dc4 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:29.472564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:29.474296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:29.606169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ce118c87904c0fb1ebb7789fce742f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.611809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fbc5a-4f51-4e26-831b-743248366aff admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:29.617522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:29.619618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:29.619989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:29.620468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] PATH_INFO: `/v3/users/99ee397113a84dae8b9ae916d029b5ad` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:29.622860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ee397113a84dae8b9ae916d029b5ad)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:29.625211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1129/2221] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:28 2022] DELETE /identity/v3/users/28ce118c87904c0fb1ebb7789fce742f => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:29.625432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:29.632073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:29.636631 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:29.933455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40d5e0-0019-4951-b097-2687fe1965a8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:29.942377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:29.945257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:29.950684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:29.951367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] PATH_INFO: `/v3/projects/1eb8c4ce64244b5d9c2bb4a83432016e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:29.954655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb8c4ce64244b5d9c2bb4a83432016e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:29.971335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:30.059860 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ee397113a84dae8b9ae916d029b5ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.098729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ee397113a84dae8b9ae916d029b5ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.099594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ee397113a84dae8b9ae916d029b5ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.298370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ee397113a84dae8b9ae916d029b5ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.299490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5140f5c1-2b30-4892-b2f5-f76c23ce1324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ee397113a84dae8b9ae916d029b5ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.347045 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1093/2222] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:29 2022] DELETE /identity/v3/users/99ee397113a84dae8b9ae916d029b5ad => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:30.356751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.357053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.357297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.386207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb8c4ce64244b5d9c2bb4a83432016e', 'request_id': 'req-f0af888b-8e4f-460d-abf7-83fac5ca8572'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.419289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:30.420775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb8c4ce64244b5d9c2bb4a83432016e', 'request_id': 'req-f0af888b-8e4f-460d-abf7-83fac5ca8572'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.422064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.524984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1094/2223] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:30.544253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:30.546307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.577566 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb8c4ce64244b5d9c2bb4a83432016e', 'request_id': 'req-f0af888b-8e4f-460d-abf7-83fac5ca8572'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.606989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] The token cache is being invalidate because project 1eb8c4ce64244b5d9c2bb4a83432016e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:30.608132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.609289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0af888b-8e4f-460d-abf7-83fac5ca8572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:30.611842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1130/2224] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:29 2022] DELETE /identity/v3/projects/1eb8c4ce64244b5d9c2bb4a83432016e => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:30.619282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4a56-edd8-4409-a62b-9191a8545007 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.619581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4a56-edd8-4409-a62b-9191a8545007 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.620109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4a56-edd8-4409-a62b-9191a8545007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.656070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-407a4a56-edd8-4409-a62b-9191a8545007 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:30.657373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-407a4a56-edd8-4409-a62b-9191a8545007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.663248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de4dee-18b2-4a62-9858-6b539383e1fc None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:30.667675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1131/2225] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:30.669345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae93b67-6595-4837-aae2-24259e01077a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.669754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae93b67-6595-4837-aae2-24259e01077a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.670821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae93b67-6595-4837-aae2-24259e01077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.680056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf3778-d93c-4260-9b34-6dc6313d45b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:30.686454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf3778-d93c-4260-9b34-6dc6313d45b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.686454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf3778-d93c-4260-9b34-6dc6313d45b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.686454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf3778-d93c-4260-9b34-6dc6313d45b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.687012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-12cf3778-d93c-4260-9b34-6dc6313d45b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.720839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-eae93b67-6595-4837-aae2-24259e01077a None None] MFA Rules not processed for user `3295a79391ea466d9d8b9c41a806fbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:30.721137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf3778-d93c-4260-9b34-6dc6313d45b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:30.721306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eae93b67-6595-4837-aae2-24259e01077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.722581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf3778-d93c-4260-9b34-6dc6313d45b7 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:30.742235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1095/2226] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:23:30.743937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a851-28c7-469e-ad94-868d979c0879 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.744248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a851-28c7-469e-ad94-868d979c0879 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.745198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a851-28c7-469e-ad94-868d979c0879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.774088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-0455a851-28c7-469e-ad94-868d979c0879 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:30.776241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0455a851-28c7-469e-ad94-868d979c0879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.785647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1096/2227] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:30.787942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:30.795144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a851-28c7-469e-ad94-868d979c0879 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:30.816758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a851-28c7-469e-ad94-868d979c0879 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:30.831752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:30.832437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.832681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.832962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.833714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:30.834034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:30.837962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:30.878420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1097/2228] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:30.882234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:30.935236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7ead-b13a-4721-8387-28e0631f3886 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:30.937638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1132/2229] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:30.952825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:30.954283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.954721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.955263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.957639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:30.963652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:30.971623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae93b67-6595-4837-aae2-24259e01077a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:30.973130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eae93b67-6595-4837-aae2-24259e01077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:31.119119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1098/2230] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/projects => generated 389 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:31.120542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.199649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae93b67-6595-4837-aae2-24259e01077a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.267107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e03f2-1a7b-4f01-a6b1-a0263ad322ea admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.275812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.277025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.277765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.278324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.279316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.281940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.420475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1099/2231] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:31 2022] POST /identity/v3/users => generated 295 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:31.426517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.442645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e3e10f9efeb4b908bf3d74ce1eb6a3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.443904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.444368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.444799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4a82-a98d-4c11-9a54-82a5f4bdace9 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.444968 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.453605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.455015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.455331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.455726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.456426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.458111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.460755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:31.496301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1100/2232] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:31.498251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.542619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1555b13-0254-472e-a12b-d4d3abfa2c13 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.563921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.567177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.568225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.568225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.570984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.576095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.619898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1101/2233] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:31.626913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.636269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.638530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.649162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0097de5-9b52-4761-b817-52c646c4e4c7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.652114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1133/2234] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:23:31.663002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.709350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.709350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:31.711412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.713240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.713240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] PATH_INFO: `/v3/projects/02b71ac89a48420a928a69d91ee15545/users/47bf6c05692d4facb1ab61b22220acc2/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.773639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f386cbf-3519-4a1f-a269-725469bc706f service glance] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.790287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b71ac89a48420a928a69d91ee15545, user_id=47bf6c05692d4facb1ab61b22220acc2, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.795396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.813673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.814815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.815145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.815429 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] PATH_INFO: `/v3/projects/d6ffff243c9543aea6765ce1847951d9` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.818547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ffff243c9543aea6765ce1847951d9)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.821875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.918517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1102/2235] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:31 2022] PUT /identity/v3/projects/02b71ac89a48420a928a69d91ee15545/users/47bf6c05692d4facb1ab61b22220acc2/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:31.923023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.958500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:32.080162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ffff243c9543aea6765ce1847951d9', 'request_id': 'req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.101981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ffff243c9543aea6765ce1847951d9', 'request_id': 'req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.207888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5b2d7-fd78-405a-82c6-c910782bf401 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:32.246710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ffff243c9543aea6765ce1847951d9', 'request_id': 'req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.278056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] The token cache is being invalidate because project d6ffff243c9543aea6765ce1847951d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:32.278865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.280777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0824b025-ccf3-40ab-bd5b-3ba9ccd858b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.284671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1134/2236] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:31 2022] DELETE /identity/v3/projects/d6ffff243c9543aea6765ce1847951d9 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:32.286892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98996413-2b0b-401d-9934-c9e5736cb2fc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:32.287423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98996413-2b0b-401d-9934-c9e5736cb2fc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:32.287860 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98996413-2b0b-401d-9934-c9e5736cb2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:32.313714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:32.314692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:32.315016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:32.315293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] PATH_INFO: `/v3/projects/613bb196e9644bf29c97114a37cd72da` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:32.316793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613bb196e9644bf29c97114a37cd72da)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:32.321826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:32.337873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-98996413-2b0b-401d-9934-c9e5736cb2fc None None] MFA Rules not processed for user `47bf6c05692d4facb1ab61b22220acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:32.339498 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-98996413-2b0b-401d-9934-c9e5736cb2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:32.497423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613bb196e9644bf29c97114a37cd72da', 'request_id': 'req-e6e894be-1c5b-4701-b3cf-603e97839ba3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.506212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613bb196e9644bf29c97114a37cd72da', 'request_id': 'req-e6e894be-1c5b-4701-b3cf-603e97839ba3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.511368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1135/2237] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:32.512930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:32.513344 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:32.513980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:32.545205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:32.548728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:32.588173 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613bb196e9644bf29c97114a37cd72da', 'request_id': 'req-e6e894be-1c5b-4701-b3cf-603e97839ba3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.604087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] The token cache is being invalidate because project 613bb196e9644bf29c97114a37cd72da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:32.604386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.605188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-e6e894be-1c5b-4701-b3cf-603e97839ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:32.607544 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1103/2238] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:31 2022] DELETE /identity/v3/projects/613bb196e9644bf29c97114a37cd72da => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:32.608793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514938-cdb5-4bc8-bb83-4a1164b91ac1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:32.609130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514938-cdb5-4bc8-bb83-4a1164b91ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:32.609417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514938-cdb5-4bc8-bb83-4a1164b91ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:32.637690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f9514938-cdb5-4bc8-bb83-4a1164b91ac1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:32.639351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f9514938-cdb5-4bc8-bb83-4a1164b91ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:32.727028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1136/2239] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:32.728567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:32.731347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:32.840648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1104/2240] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:32.843543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:32.843841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:32.844118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:32.915380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:32.929322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:32.932243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:32.967430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1105/2241] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:32.969167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:32.977091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:33.032725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2031882-963d-4cf5-a6b9-0875ba2b25d3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.048441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.051886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.052803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.054928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.059248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.064027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:33.102727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12f833-5657-4980-a938-0d90eea7d5f1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.108844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb781f-c323-4a37-beaa-5cd908db808d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.109487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb781f-c323-4a37-beaa-5cd908db808d service swift] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.109776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb781f-c323-4a37-beaa-5cd908db808d service swift] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.110061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb781f-c323-4a37-beaa-5cd908db808d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.142523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb781f-c323-4a37-beaa-5cd908db808d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.145458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb781f-c323-4a37-beaa-5cd908db808d service swift] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:33.157674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1106/2242] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:23:33.160198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de7f7-6add-408b-b835-69a4189990ff None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.160893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de7f7-6add-408b-b835-69a4189990ff None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.161034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de7f7-6add-408b-b835-69a4189990ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.202127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7d4de7f7-6add-408b-b835-69a4189990ff None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:33.205479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7d4de7f7-6add-408b-b835-69a4189990ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:33.248339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1107/2243] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:33.250606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026404-473b-4679-9df2-983ec38c9f06 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.251096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026404-473b-4679-9df2-983ec38c9f06 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.251642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026404-473b-4679-9df2-983ec38c9f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.273720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1137/2244] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:32 2022] POST /identity/v3/projects => generated 387 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:33.277526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:33.300628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-dd026404-473b-4679-9df2-983ec38c9f06 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:33.310057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-dd026404-473b-4679-9df2-983ec38c9f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:33.414527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6725-db1c-4a46-bd06-609c5669bd1e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.422889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.423999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.424548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.425014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.426594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:33.427246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.431574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:33.452100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1138/2245] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:33.453703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:33.484014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd2ead-4488-4485-9cc7-78135de2e60d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.491341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1108/2246] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:33.493470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd026404-473b-4679-9df2-983ec38c9f06 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:33.503160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.504212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.508366 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.515639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.518378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.522844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:33.531670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd026404-473b-4679-9df2-983ec38c9f06 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.541010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.541010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.541010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.541827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.542579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.549868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:33.697098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1139/2247] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:33 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:33.698100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:33.722965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818559c-36f3-4b95-8c82-1020d88503a6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.739705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.740650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.740650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.749146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.749146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:33.749146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.749146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:33.768695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1109/2248] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:33 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:33.768695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:33.780534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1140/2249] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:33.782195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:33.795591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57aa73-6cde-49c3-bba7-2b4a27965b83 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.974264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.978116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.979198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.979519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.980215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.982706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.092377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd614f-b44c-43f7-b243-6b11033783f0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.124399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.125067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.132504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.132887 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.134397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.143718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.153161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1141/2250] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:33 2022] POST /identity/v3/users => generated 285 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:34.162471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:34.188724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aace6-f9f8-47dd-b006-dc55de9bce02 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.193048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1110/2251] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:34.194863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:34.208773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.209430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.209712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.209992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.212618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.213595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.224759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b657c0c-06d0-49ae-9ccb-1298f047df99 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.234207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.235311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.235826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.236328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.237995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.241216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.303751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1111/2252] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:34.330066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:34.360124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f521f-b48f-4b52-bd76-70193e0c9b4e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.371839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1142/2253] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:34 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:34.372320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.376531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:34.402089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.402671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.403175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] PATH_INFO: `/v3/projects/35e0026acc83416f94b7d943cee1ea09/users/20f70fa4bff9493d8c5253cef41000c1/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.443684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e0026acc83416f94b7d943cee1ea09, user_id=20f70fa4bff9493d8c5253cef41000c1, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.449193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.609330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1112/2254] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:34 2022] PUT /identity/v3/projects/35e0026acc83416f94b7d943cee1ea09/users/20f70fa4bff9493d8c5253cef41000c1/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:34.620992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:34.628674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c94d-1ced-4e72-8aed-75c348bfd0b6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.790379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c48a3-345e-4e67-bf98-5af04d5bf000 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.808308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.809293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.809764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.810198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.811039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.816765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.925822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.926598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.926959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.927241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.927916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.929705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.949402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1143/2255] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:34.950141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:34.970147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd396-7982-4965-8a1f-99d7acf03971 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.983937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.984543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.984824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.985111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.986201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.996139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:35.036143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1144/2256] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:35.037169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:35.062938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21540d6-2a9a-43d8-9455-237acc1f0f1a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:35.300649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1113/2257] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:34 2022] POST /identity/v3/users => generated 287 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:35.300649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:35.304181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:35.304181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:35.304181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:35.304181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] PATH_INFO: `/v3/projects/5fb494caca4c4882bbfe9a93840ef401/users/4c606e10e675462a964258a3a70456e7/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:35.304925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086b30-97f9-4b0c-af5e-648c99dafe2c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:35.304925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:35.304925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:35.304925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:35.306170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] PATH_INFO: `/v3/projects/35e0026acc83416f94b7d943cee1ea09/users/20f70fa4bff9493d8c5253cef41000c1/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:35.306170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e0026acc83416f94b7d943cee1ea09, user_id=20f70fa4bff9493d8c5253cef41000c1, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:35.306170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:35.306170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1114/2258] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:35 2022] PUT /identity/v3/projects/35e0026acc83416f94b7d943cee1ea09/users/20f70fa4bff9493d8c5253cef41000c1/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:35.306442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb494caca4c4882bbfe9a93840ef401, user_id=4c606e10e675462a964258a3a70456e7, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:35.306442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:35.306594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:35.517143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9723-ff6c-4807-9e72-d6cfc03be38c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:35.531653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39c2b9-3a1a-4922-afdd-92a774e5e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:35.532465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39c2b9-3a1a-4922-afdd-92a774e5e8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:35.532805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39c2b9-3a1a-4922-afdd-92a774e5e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:35.533094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39c2b9-3a1a-4922-afdd-92a774e5e8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:35.533824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39c2b9-3a1a-4922-afdd-92a774e5e8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:35.535547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39c2b9-3a1a-4922-afdd-92a774e5e8f0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:35.653591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1115/2259] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:35.657559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a428c-bf78-4b1d-97bf-e2343a87c536 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:35.658059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a428c-bf78-4b1d-97bf-e2343a87c536 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:35.658561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a428c-bf78-4b1d-97bf-e2343a87c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:35.768423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-035a428c-bf78-4b1d-97bf-e2343a87c536 None None] MFA Rules not processed for user `20f70fa4bff9493d8c5253cef41000c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:35.770786 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-035a428c-bf78-4b1d-97bf-e2343a87c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:36.006016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1116/2260] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:36.006016 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a428c-bf78-4b1d-97bf-e2343a87c536 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:36.023070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a428c-bf78-4b1d-97bf-e2343a87c536 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:36.029118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:36.029757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.030047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.030328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.031155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:36.033237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:36.046272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1117/2261] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:36.052332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:36.052332 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:36.090750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1145/2262] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:35 2022] PUT /identity/v3/projects/5fb494caca4c4882bbfe9a93840ef401/users/4c606e10e675462a964258a3a70456e7/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:36.104207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:36.159923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb8482-52e4-4730-9d06-f1ecbacdbd5d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:36.184743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:36.241751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda413-83e9-47b0-9369-671d104cdad5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:36.265068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a514f7e-4e87-4bd1-bea8-2fd895ceb836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:36.266145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514f7e-4e87-4bd1-bea8-2fd895ceb836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.266665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514f7e-4e87-4bd1-bea8-2fd895ceb836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.267193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514f7e-4e87-4bd1-bea8-2fd895ceb836 admin admin] PATH_INFO: `/v3/projects/5f0c454fc4f14e7cb33582566d510164/users/70aa263746b248508aa2c4f844c56d40/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.305160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514f7e-4e87-4bd1-bea8-2fd895ceb836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0c454fc4f14e7cb33582566d510164, user_id=70aa263746b248508aa2c4f844c56d40, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:36.313823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514f7e-4e87-4bd1-bea8-2fd895ceb836 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:36.382727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e8cd9-f488-4150-8af4-d6739d550801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:36.386015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e8cd9-f488-4150-8af4-d6739d550801 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.402975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e8cd9-f488-4150-8af4-d6739d550801 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.403699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e8cd9-f488-4150-8af4-d6739d550801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.497783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1146/2263] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:36 2022] PUT /identity/v3/projects/5f0c454fc4f14e7cb33582566d510164/users/70aa263746b248508aa2c4f844c56d40/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:36.500765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697f139-c312-44b0-98a3-208b5f2660ac None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.501133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697f139-c312-44b0-98a3-208b5f2660ac None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.501314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697f139-c312-44b0-98a3-208b5f2660ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.562953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d697f139-c312-44b0-98a3-208b5f2660ac None None] MFA Rules not processed for user `4c606e10e675462a964258a3a70456e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:36.564727 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d697f139-c312-44b0-98a3-208b5f2660ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:36.619382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e8cd9-f488-4150-8af4-d6739d550801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:36.621011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e8cd9-f488-4150-8af4-d6739d550801 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:36.670498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1118/2264] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:36.674586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5ef20-1b42-40b7-85cd-4c9bbb3303bf None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.675634 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5ef20-1b42-40b7-85cd-4c9bbb3303bf None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.676450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5ef20-1b42-40b7-85cd-4c9bbb3303bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.709151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1147/2265] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:36.773762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-abe5ef20-1b42-40b7-85cd-4c9bbb3303bf None None] MFA Rules not processed for user `70aa263746b248508aa2c4f844c56d40`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:36.778774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-abe5ef20-1b42-40b7-85cd-4c9bbb3303bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:36.788748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:36.949308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1119/2266] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:36.973011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697f139-c312-44b0-98a3-208b5f2660ac None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:36.995723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5ef20-1b42-40b7-85cd-4c9bbb3303bf None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:37.122527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697f139-c312-44b0-98a3-208b5f2660ac None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:37.138303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b984e-a306-4d57-ad39-a77d8fe7ba27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:37.140635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b984e-a306-4d57-ad39-a77d8fe7ba27 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:37.141014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b984e-a306-4d57-ad39-a77d8fe7ba27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:37.141422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b984e-a306-4d57-ad39-a77d8fe7ba27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:37.144905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5ef20-1b42-40b7-85cd-4c9bbb3303bf None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:37.165692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:37.178056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b984e-a306-4d57-ad39-a77d8fe7ba27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:37.179874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b984e-a306-4d57-ad39-a77d8fe7ba27 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:37.203815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1148/2267] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:37.217717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:37.225374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:37.225374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] PATH_INFO: `/v3/users/47bf6c05692d4facb1ab61b22220acc2` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:37.226819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bf6c05692d4facb1ab61b22220acc2)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:37.230133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:37.559234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bf6c05692d4facb1ab61b22220acc2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:37.599552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bf6c05692d4facb1ab61b22220acc2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:37.600632 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bf6c05692d4facb1ab61b22220acc2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:37.773525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bf6c05692d4facb1ab61b22220acc2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:37.775747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bf6c05692d4facb1ab61b22220acc2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:37.814736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1120/2268] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:36 2022] DELETE /identity/v3/users/47bf6c05692d4facb1ab61b22220acc2 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:37.820272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:37.821923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:37.822723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:37.865256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:37.867569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:38.071903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1149/2269] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:38.086488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:38.094487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:38.199949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72f71-0cd1-4f84-af92-0f49482b2dca admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:38.204752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:38.205676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:38.205969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:38.206666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:38.221069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:38.222566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:38.235435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1121/2270] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:39.144554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:39.148053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:39.427588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47508083-c1f0-4bcf-8305-818f77c93af4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:39.440099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43adcb-0d3e-4d63-881d-8c6863be43e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e3e10f9efeb4b908bf3d74ce1eb6a3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:39.441181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43adcb-0d3e-4d63-881d-8c6863be43e9 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:39.441632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43adcb-0d3e-4d63-881d-8c6863be43e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:39.442123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43adcb-0d3e-4d63-881d-8c6863be43e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:39.449173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4f43adcb-0d3e-4d63-881d-8c6863be43e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:39.615054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43adcb-0d3e-4d63-881d-8c6863be43e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:39.625213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43adcb-0d3e-4d63-881d-8c6863be43e9 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:39.655249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1150/2271] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:23:39.747223 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:39.749879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:39.816662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681988f-d7b3-4946-9d0e-f9fabc5f62fc service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:39.866493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:39.867194 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:39.868208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:39.868658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] PATH_INFO: `/v3/projects/02b71ac89a48420a928a69d91ee15545` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:39.870482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b71ac89a48420a928a69d91ee15545)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:39.873019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:39.906197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74e05-6bbb-4403-9404-1c72b2698804 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:39.906481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74e05-6bbb-4403-9404-1c72b2698804 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:39.906813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74e05-6bbb-4403-9404-1c72b2698804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:39.930983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9df74e05-6bbb-4403-9404-1c72b2698804 None None] MFA Rules not processed for user `70aa263746b248508aa2c4f844c56d40`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:39.932094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9df74e05-6bbb-4403-9404-1c72b2698804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:40.045139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1151/2272] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:40.304116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:40.361646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b71ac89a48420a928a69d91ee15545', 'request_id': 'req-a7e6fd66-aa9c-4c64-9eef-bed9effae567'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:40.368283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b71ac89a48420a928a69d91ee15545', 'request_id': 'req-a7e6fd66-aa9c-4c64-9eef-bed9effae567'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:40.806511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b71ac89a48420a928a69d91ee15545', 'request_id': 'req-a7e6fd66-aa9c-4c64-9eef-bed9effae567'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:40.825648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] The token cache is being invalidate because project 02b71ac89a48420a928a69d91ee15545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:40.826225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:40.828065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a7e6fd66-aa9c-4c64-9eef-bed9effae567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:40.831102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1122/2273] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:39 2022] DELETE /identity/v3/projects/02b71ac89a48420a928a69d91ee15545 => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:40.834842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df74e05-6bbb-4403-9404-1c72b2698804 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:40.849639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df74e05-6bbb-4403-9404-1c72b2698804 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:40.862391 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:40.863040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:40.863040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:40.891888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] MFA Rules not processed for user `8cacffb3524f4f8ea97946e5e4af1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:40.894108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:41.043360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:41.046250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:41.051949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:41.051949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] PATH_INFO: `/v3/users/20f70fa4bff9493d8c5253cef41000c1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:41.061827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f70fa4bff9493d8c5253cef41000c1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:41.068858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:41.235123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1123/2274] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:41.503244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f70fa4bff9493d8c5253cef41000c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:41.541390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f70fa4bff9493d8c5253cef41000c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:41.556211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f70fa4bff9493d8c5253cef41000c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:41.557540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f70fa4bff9493d8c5253cef41000c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:41.697757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83a34864-05af-4f2f-841f-4baa8f9d021d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f70fa4bff9493d8c5253cef41000c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:41.727220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1152/2275] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:40 2022] DELETE /identity/v3/users/20f70fa4bff9493d8c5253cef41000c1 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:42.649905 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:42.653139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:42.735753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81ccd-f0b4-47a2-b1cf-932f01706edc None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:42.890700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:42.892217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:42.892788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:42.907733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] PATH_INFO: `/v3/projects/35e0026acc83416f94b7d943cee1ea09` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:42.912163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e0026acc83416f94b7d943cee1ea09)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:42.927256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:43.161808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e0026acc83416f94b7d943cee1ea09', 'request_id': 'req-d6a762ad-f077-4009-952f-b7bfbd6cf155'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:43.182787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e0026acc83416f94b7d943cee1ea09', 'request_id': 'req-d6a762ad-f077-4009-952f-b7bfbd6cf155'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:43.319531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e0026acc83416f94b7d943cee1ea09', 'request_id': 'req-d6a762ad-f077-4009-952f-b7bfbd6cf155'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:43.366378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] The token cache is being invalidate because project 35e0026acc83416f94b7d943cee1ea09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:43.366378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:43.368216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d6a762ad-f077-4009-952f-b7bfbd6cf155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:43.376238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1124/2276] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:42 2022] DELETE /identity/v3/projects/35e0026acc83416f94b7d943cee1ea09 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:43.377907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32294874-c840-4117-a3dc-43736e992fc2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:43.378432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32294874-c840-4117-a3dc-43736e992fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:43.378526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32294874-c840-4117-a3dc-43736e992fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:43.403010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-32294874-c840-4117-a3dc-43736e992fc2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:43.404980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-32294874-c840-4117-a3dc-43736e992fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:43.602977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1153/2277] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:43.611100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1391c-a21d-46ba-a6af-25d5ff2af4c0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:43.611569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1391c-a21d-46ba-a6af-25d5ff2af4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:43.611954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1391c-a21d-46ba-a6af-25d5ff2af4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:43.658265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e5f1391c-a21d-46ba-a6af-25d5ff2af4c0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:43.660777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e5f1391c-a21d-46ba-a6af-25d5ff2af4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:43.674187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1125/2278] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:43.678438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32294874-c840-4117-a3dc-43736e992fc2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:43.696080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32294874-c840-4117-a3dc-43736e992fc2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:43.715219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:43.716733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:43.717895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:43.718413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:43.719413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:43.719905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:43.723464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:43.742261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:43.750922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1154/2279] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:23:43.752963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1391c-a21d-46ba-a6af-25d5ff2af4c0 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:43.769739 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1391c-a21d-46ba-a6af-25d5ff2af4c0 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:43.775884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:43.776684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:43.776967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:43.778085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:43.778085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:43.780179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:44.131883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1126/2280] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:43 2022] POST /identity/v3/projects => generated 359 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:44.135620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:44.176132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0106ac-f673-4452-8f17-dcab09f3083a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:44.317707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:44.435308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:44.439038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:44.439557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:44.445118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:44.449137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:44.458291 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:44.683204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1155/2281] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:44 2022] POST /identity/v3/users => generated 280 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:44.687889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:44.738960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0516-c8c2-4c03-9e2d-78688bbac8f1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:44.772543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:44.775226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:44.775711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:44.776127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:44.777165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:44.786559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:44.817144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1127/2282] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:44.823686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:44.858337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff8dc3-cb9a-4623-b6d3-9ff20264ccca admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:44.876360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e65af-977f-4fce-b1b1-1de48fd7f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:44.911168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e65af-977f-4fce-b1b1-1de48fd7f31b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:44.911168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e65af-977f-4fce-b1b1-1de48fd7f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:44.911168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e65af-977f-4fce-b1b1-1de48fd7f31b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:44.911168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e65af-977f-4fce-b1b1-1de48fd7f31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:44.911168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e65af-977f-4fce-b1b1-1de48fd7f31b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:44.940278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1156/2283] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:44.951086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:44.966390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aa2b1-c0be-4cd1-95d6-9199c2ff4786 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:44.989314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:44.989314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:44.989314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:44.989314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] PATH_INFO: `/v3/projects/3e00d1f7a5e84ce7a0470cb9a16ca870/users/b812129b19d94cb6b60de108120b645a/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:45.069985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e00d1f7a5e84ce7a0470cb9a16ca870, user_id=b812129b19d94cb6b60de108120b645a, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:45.084066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:45.295618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1128/2284] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:44 2022] PUT /identity/v3/projects/3e00d1f7a5e84ce7a0470cb9a16ca870/users/b812129b19d94cb6b60de108120b645a/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:45.317347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed7b41-14e9-411b-a936-64c755d669c3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:45.317896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed7b41-14e9-411b-a936-64c755d669c3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:45.318425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed7b41-14e9-411b-a936-64c755d669c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:45.408011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-05ed7b41-14e9-411b-a936-64c755d669c3 None None] MFA Rules not processed for user `b812129b19d94cb6b60de108120b645a`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:45.409407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-05ed7b41-14e9-411b-a936-64c755d669c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:45.579902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1157/2285] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:45.622234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:45.624871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:45.842115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca961ba-e6e2-4743-bd2a-0be1c7c23201 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:45.862662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2890-cdb3-4048-8ab1-da897499213b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:45.863916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2890-cdb3-4048-8ab1-da897499213b service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:45.864401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2890-cdb3-4048-8ab1-da897499213b service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:45.864869 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2890-cdb3-4048-8ab1-da897499213b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:45.910447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa2890-cdb3-4048-8ab1-da897499213b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:45.912809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa2890-cdb3-4048-8ab1-da897499213b service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:45.928935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1129/2286] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:45.971821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed7b41-14e9-411b-a936-64c755d669c3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:46.146726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed7b41-14e9-411b-a936-64c755d669c3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:46.146726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:46.146726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:46.146726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:46.147229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] PATH_INFO: `/v3/users/b812129b19d94cb6b60de108120b645a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:46.147229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b812129b19d94cb6b60de108120b645a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:46.148648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:46.750272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b812129b19d94cb6b60de108120b645a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:46.776413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b812129b19d94cb6b60de108120b645a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:46.788807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b812129b19d94cb6b60de108120b645a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:46.791526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b812129b19d94cb6b60de108120b645a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:46.886160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b812129b19d94cb6b60de108120b645a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:46.920479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1158/2287] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:45 2022] DELETE /identity/v3/users/b812129b19d94cb6b60de108120b645a => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:46.926244 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:46.928810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:46.929817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:47.001312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:47.006367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:47.165747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1130/2288] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:47.205164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:47.206682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:47.418189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290444b5-943d-4bbe-a5c6-6bd778f61eef admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:47.430814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f544-e8d0-4563-9edf-8196adbe2552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:47.436387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f544-e8d0-4563-9edf-8196adbe2552 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:47.436900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f544-e8d0-4563-9edf-8196adbe2552 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:47.437189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f544-e8d0-4563-9edf-8196adbe2552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:47.461371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f544-e8d0-4563-9edf-8196adbe2552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:47.467490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f544-e8d0-4563-9edf-8196adbe2552 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:47.484284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1159/2289] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:48.574520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:48.586838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:48.637360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e268-34e9-4d59-90d5-f74033621276 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:48.652048 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:48.653024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:48.653310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:48.653577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] PATH_INFO: `/v3/projects/3e00d1f7a5e84ce7a0470cb9a16ca870` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:48.655356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e00d1f7a5e84ce7a0470cb9a16ca870)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:48.659273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:48.795392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:48.971119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e00d1f7a5e84ce7a0470cb9a16ca870', 'request_id': 'req-59606c46-be74-4f49-9635-c3617694466c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.004397 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e00d1f7a5e84ce7a0470cb9a16ca870', 'request_id': 'req-59606c46-be74-4f49-9635-c3617694466c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.122418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:49.125944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e00d1f7a5e84ce7a0470cb9a16ca870', 'request_id': 'req-59606c46-be74-4f49-9635-c3617694466c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.219399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] The token cache is being invalidate because project 3e00d1f7a5e84ce7a0470cb9a16ca870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:49.222581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.234451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-59606c46-be74-4f49-9635-c3617694466c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.241776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1131/2290] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:48 2022] DELETE /identity/v3/projects/3e00d1f7a5e84ce7a0470cb9a16ca870 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:49.250717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0926b6-b7f1-419c-a1fc-d4abd02f16bf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.251214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0926b6-b7f1-419c-a1fc-d4abd02f16bf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.254220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0926b6-b7f1-419c-a1fc-d4abd02f16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.364392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3f0926b6-b7f1-419c-a1fc-d4abd02f16bf None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:49.366228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3f0926b6-b7f1-419c-a1fc-d4abd02f16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:49.555959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1160/2291] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:49.572872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34993380-5d09-4648-88e2-40e235a3c11f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.573341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34993380-5d09-4648-88e2-40e235a3c11f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.575253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34993380-5d09-4648-88e2-40e235a3c11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.641911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-34993380-5d09-4648-88e2-40e235a3c11f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:49.647132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-34993380-5d09-4648-88e2-40e235a3c11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:49.678398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1132/2292] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:49.683588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0926b6-b7f1-419c-a1fc-d4abd02f16bf None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:49.713812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0926b6-b7f1-419c-a1fc-d4abd02f16bf None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:49.724865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:49.725666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.726052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.726453 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.735046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:49.735046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:49.740062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:49.759858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:49.777529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1161/2293] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:23:49.780765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34993380-5d09-4648-88e2-40e235a3c11f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:49.802815 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34993380-5d09-4648-88e2-40e235a3c11f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:49.822682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:49.823781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.829376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.830050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.831612 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:49.835101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.078246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1133/2294] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:49 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:50.090146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.103269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7f3e4-ee56-4254-87d7-a3f55a3f16df admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.280878 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.281692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.282120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.282536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.283987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.287503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.471279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1162/2295] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:50 2022] POST /identity/v3/users => generated 292 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:50.474115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.491750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9226c4-129d-4d79-ba77-dcfe38ad955a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.508819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.509819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.510260 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.510726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.511761 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.513744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.528989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1134/2296] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:50.532936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.567345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b2564-d789-4c24-a7a5-522f6bf71ea1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.583719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61df0f9-9691-4b80-8ba4-20f3b3054a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.584852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61df0f9-9691-4b80-8ba4-20f3b3054a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.585745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61df0f9-9691-4b80-8ba4-20f3b3054a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.586956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61df0f9-9691-4b80-8ba4-20f3b3054a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.589776 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61df0f9-9691-4b80-8ba4-20f3b3054a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.592330 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61df0f9-9691-4b80-8ba4-20f3b3054a6e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.622840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.626051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1163/2297] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:50.638456 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52e61c-8367-4fa3-a5af-fea2b6006bd8 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.645256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.646396 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.647159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.651419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] PATH_INFO: `/v3/projects/11fb3890c76b4b60bac49fdcb8dbb71e/users/4e62a4adc12f4963b09b495122c0a6d5/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.673297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fb3890c76b4b60bac49fdcb8dbb71e, user_id=4e62a4adc12f4963b09b495122c0a6d5, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.677217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.876520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1135/2298] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:50 2022] PUT /identity/v3/projects/11fb3890c76b4b60bac49fdcb8dbb71e/users/4e62a4adc12f4963b09b495122c0a6d5/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:50.883304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbacf05-0d6b-4eb6-ab3f-2d6385d25ea9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.883304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbacf05-0d6b-4eb6-ab3f-2d6385d25ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.883910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbacf05-0d6b-4eb6-ab3f-2d6385d25ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.926772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6fbacf05-0d6b-4eb6-ab3f-2d6385d25ea9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:50.932742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6fbacf05-0d6b-4eb6-ab3f-2d6385d25ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:51.154695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1164/2299] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:51.198204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:51.201946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:51.347657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c8ff-5b98-4716-bde2-a4e59fe5957d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:51.356955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:51.358021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:51.359921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:51.359921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:51.384784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:51.388006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:51.411904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1136/2300] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:51.814009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:52.477280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:53.901422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:55.019899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a0f3-93ff-47d8-965f-852c166b7ce1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:55.019899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a0f3-93ff-47d8-965f-852c166b7ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:55.019899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a0f3-93ff-47d8-965f-852c166b7ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:55.056568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-edf5a0f3-93ff-47d8-965f-852c166b7ce1 None None] MFA Rules not processed for user `4e62a4adc12f4963b09b495122c0a6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:55.057831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-edf5a0f3-93ff-47d8-965f-852c166b7ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:55.156572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1165/2301] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:55.172175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:55.177613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:55.263588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13860f-e194-45cc-848c-ceec0bbe2719 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:55.269078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3e8af-b1ef-48c8-8c47-38de2ee7d4db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:55.270386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3e8af-b1ef-48c8-8c47-38de2ee7d4db service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:55.270913 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3e8af-b1ef-48c8-8c47-38de2ee7d4db service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:55.271556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3e8af-b1ef-48c8-8c47-38de2ee7d4db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:55.286822 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:55.288673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3e8af-b1ef-48c8-8c47-38de2ee7d4db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:55.292276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3e8af-b1ef-48c8-8c47-38de2ee7d4db service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:55.311967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1137/2302] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:23:55.832591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:56.393770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777046-b355-4c4b-83bd-a0aa3ea7cd7b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:56.394974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777046-b355-4c4b-83bd-a0aa3ea7cd7b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:56.395423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777046-b355-4c4b-83bd-a0aa3ea7cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:56.473166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b7777046-b355-4c4b-83bd-a0aa3ea7cd7b None None] MFA Rules not processed for user `d8e620b4ca454bc5a6a19ae55138d861`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:56.475202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b7777046-b355-4c4b-83bd-a0aa3ea7cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:56.577399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1166/2303] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:57.659079 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:57.659690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:57.659690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:57.685843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] MFA Rules not processed for user `4e62a4adc12f4963b09b495122c0a6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:57.687240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:57.694749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1138/2304] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:23:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:59.321462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:00.141412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:03.490015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:04.445099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:06.050842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:06.193030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:06.838732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:07.941140 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:08.753886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:09.042875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:09.043316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:09.043713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:09.066123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:09.067791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:09.136213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1167/2305] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:24:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:09.149507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:09.151454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:09.243496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182bddd-7915-4a46-bb07-db9e9c7fc148 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:09.249565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e0ced-c520-4653-b30e-1f087d0ec9b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:09.250542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0ced-c520-4653-b30e-1f087d0ec9b9 service swift] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:09.250976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0ced-c520-4653-b30e-1f087d0ec9b9 service swift] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:09.251360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0ced-c520-4653-b30e-1f087d0ec9b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:09.265511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e0ced-c520-4653-b30e-1f087d0ec9b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:09.267206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e0ced-c520-4653-b30e-1f087d0ec9b9 service swift] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:09.283479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1139/2306] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:24:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 20:24:09.568139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:09.638688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:11.547467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:11.810480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:13.649700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:13.651210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:13.667221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0646f4-00cb-4c83-bc6b-276b53549805 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:13.673970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:13.674695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:13.675128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:13.675333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] PATH_INFO: `/v3/users/4c606e10e675462a964258a3a70456e7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:13.676658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c606e10e675462a964258a3a70456e7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:13.678761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:13.924256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:13.931640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c606e10e675462a964258a3a70456e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:13.947217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c606e10e675462a964258a3a70456e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:13.956134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c606e10e675462a964258a3a70456e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:13.956977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c606e10e675462a964258a3a70456e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:14.033038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c606e10e675462a964258a3a70456e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:14.042484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1168/2307] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:13 2022] DELETE /identity/v3/users/4c606e10e675462a964258a3a70456e7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:14.047807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:14.048121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:14.048399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:14.072167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:14.073435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:14.144871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1140/2308] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:14.161295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:14.164106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:14.188040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:14.243353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0994c-b1a2-440c-b3fd-24d921de4d7f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:14.247321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:14.247967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:14.250575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:14.251015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:14.261814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:14.263314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:14.275003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1169/2309] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:14.863451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:14.865425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:14.880212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aa83d-8049-48e2-95d8-e914c6dec72c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:14.887419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:14.888714 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:14.889515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:14.889803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] PATH_INFO: `/v3/projects/5fb494caca4c4882bbfe9a93840ef401` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:14.892856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb494caca4c4882bbfe9a93840ef401)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:14.893432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:15.028058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb494caca4c4882bbfe9a93840ef401', 'request_id': 'req-376c3cac-96c3-4ea1-9d56-7ca9fef89362'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:15.033708 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb494caca4c4882bbfe9a93840ef401', 'request_id': 'req-376c3cac-96c3-4ea1-9d56-7ca9fef89362'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:15.106646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb494caca4c4882bbfe9a93840ef401', 'request_id': 'req-376c3cac-96c3-4ea1-9d56-7ca9fef89362'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:15.119615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] The token cache is being invalidate because project 5fb494caca4c4882bbfe9a93840ef401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:15.119912 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:15.120585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-376c3cac-96c3-4ea1-9d56-7ca9fef89362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:15.122132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1141/2310] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:14 2022] DELETE /identity/v3/projects/5fb494caca4c4882bbfe9a93840ef401 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:15.347419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:15.451470 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:16.089551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:16.250448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.004625 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.141458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.609666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.764416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:18.187506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:18.524866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:18.660993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:19.084073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:19.370408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:19.782405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:20.001282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:20.044348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:20.410376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:20.465341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:20.703739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:20.781733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:20.930553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:21.103611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:21.167043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:21.449762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:21.541226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:21.638230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.061687 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.126213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.283965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.399161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.432987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.690436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.805144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.953812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.119282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.155434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.216737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.436884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.519075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.800304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.836902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:24.916362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.066572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.175644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.255250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.319128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.352638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.438842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.495665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.594097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.689894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:31.267870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:31.271514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:31.509296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f61fdb-14ea-40b8-9a8d-43148b5fdd92 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:31.690378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:31.691092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:31.691375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:31.691653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:31.694304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:31.710693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:31.712693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:31.730413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1170/2311] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:34.618989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc906de-922b-40ec-891a-7f2083e7268b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:34.624550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc906de-922b-40ec-891a-7f2083e7268b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:34.624550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc906de-922b-40ec-891a-7f2083e7268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:34.642935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-abc906de-922b-40ec-891a-7f2083e7268b None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:34.644384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-abc906de-922b-40ec-891a-7f2083e7268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:34.760524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1142/2312] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:24:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:34.797611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:34.800031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:34.874916 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:34.906083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375cde2-87bf-4f9e-a540-f5c0013216f2 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:34.915897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:34.916963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:34.917461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:34.917966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:34.933733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:34.937805 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:34.951293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1171/2313] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:24:36.100095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d030941-26ae-4380-b2a4-e57c0449dc5e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:36.101478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d030941-26ae-4380-b2a4-e57c0449dc5e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:36.101641 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d030941-26ae-4380-b2a4-e57c0449dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:36.109433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:36.124666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-8d030941-26ae-4380-b2a4-e57c0449dc5e None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:36.125909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8d030941-26ae-4380-b2a4-e57c0449dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:36.133940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1143/2314] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 17 20:24:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:36.149250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:36.160729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9f86-0e1f-4d39-a5ac-8485fe305723 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:36.167172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:36.167841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:36.168130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:36.168418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:36.177684 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:36.180207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:36.189723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1172/2315] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:24:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:24:37.099587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975651-2e03-4c84-92a8-83b4947a8564 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:37.099873 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975651-2e03-4c84-92a8-83b4947a8564 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:37.100184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975651-2e03-4c84-92a8-83b4947a8564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:37.120930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5e975651-2e03-4c84-92a8-83b4947a8564 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:37.122197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5e975651-2e03-4c84-92a8-83b4947a8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:37.130053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1144/2316] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:37.143781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:37.154914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f38ec-2e77-4ceb-8aff-c66468564dba service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:37.160703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:37.161317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:37.161596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:37.161962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:37.174293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:37.176146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:37.187160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1173/2317] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 20:24:37.932875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:37.933168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:37.933449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:37.953334 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:37.954551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:37.963841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1145/2318] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 17 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:37.977597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:37.990530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3ece-510c-4290-a15d-66fd15a87c74 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:37.997509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:37.998142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:37.998428 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:37.998785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:38.009329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:38.011005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:38.034707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1174/2319] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:24:38.252312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:38.262498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:38.337926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98d33b-d009-42e0-8867-5c44b438185b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:38.343535 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f276e2-7129-4631-a098-b4dd9628db4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:38.344945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f276e2-7129-4631-a098-b4dd9628db4c service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:38.344945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f276e2-7129-4631-a098-b4dd9628db4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:38.345407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f276e2-7129-4631-a098-b4dd9628db4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:38.347567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-06f276e2-7129-4631-a098-b4dd9628db4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:38.454921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f276e2-7129-4631-a098-b4dd9628db4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:38.456477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f276e2-7129-4631-a098-b4dd9628db4c service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:38.468559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1146/2320] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:41.140976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:41.142501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:41.250095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7812ad-69c2-4874-a900-19f1199a4513 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:41.255942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:41.258217 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:41.258910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:41.259387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] PATH_INFO: `/v3/users/70aa263746b248508aa2c4f844c56d40` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:41.260900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70aa263746b248508aa2c4f844c56d40)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:41.263483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:41.514997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70aa263746b248508aa2c4f844c56d40'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:41.536608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70aa263746b248508aa2c4f844c56d40'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:41.546192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70aa263746b248508aa2c4f844c56d40'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:41.547456 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70aa263746b248508aa2c4f844c56d40'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:41.620919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70aa263746b248508aa2c4f844c56d40'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:41.633872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1175/2321] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:41 2022] DELETE /identity/v3/users/70aa263746b248508aa2c4f844c56d40 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:41.640123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:41.641043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:41.641483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:41.684545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:41.685423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:41.794956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1147/2322] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:41.807019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:41.809876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:41.837034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:41.955120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338d89-6b8d-4010-b32f-a7262fb6afd5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:41.962020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:41.962682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:41.962972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:41.963248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:41.974572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:41.976671 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:41.988427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1176/2323] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:42.274801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:42.276438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:42.291505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618cfcc-f0f3-4226-a973-c39007c16de2 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:42.297859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:42.298509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:42.299106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:42.299216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] PATH_INFO: `/v3/projects/5f0c454fc4f14e7cb33582566d510164` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:42.310192 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0c454fc4f14e7cb33582566d510164)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:42.312601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:42.452291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:42.484267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0c454fc4f14e7cb33582566d510164', 'request_id': 'req-887aa640-7e6f-4b20-8e3c-5bf8be23479f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:42.490395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0c454fc4f14e7cb33582566d510164', 'request_id': 'req-887aa640-7e6f-4b20-8e3c-5bf8be23479f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:42.592027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0c454fc4f14e7cb33582566d510164', 'request_id': 'req-887aa640-7e6f-4b20-8e3c-5bf8be23479f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:42.611861 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] The token cache is being invalidate because project 5f0c454fc4f14e7cb33582566d510164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:42.612155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:42.614420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-887aa640-7e6f-4b20-8e3c-5bf8be23479f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:42.617031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1148/2324] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:42 2022] DELETE /identity/v3/projects/5f0c454fc4f14e7cb33582566d510164 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:52.123061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=21 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:52.614601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:54.009922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:54.019021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecfc2c-b682-454f-bcf2-aebf9941cffa service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:54.071381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:54.072013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:54.072302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:54.072583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:54.074410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:54.145604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:54.147705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:54.158325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1177/2325] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:01.351501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce9ca0-aa13-4651-8abf-12407e99fbea None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:01.352091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce9ca0-aa13-4651-8abf-12407e99fbea None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:01.352489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce9ca0-aa13-4651-8abf-12407e99fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:01.388852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-77ce9ca0-aa13-4651-8abf-12407e99fbea None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:01.391306 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-77ce9ca0-aa13-4651-8abf-12407e99fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:01.510180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1149/2326] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:01.527696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:01.529634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:01.633974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54720b6a-120b-4468-897a-6df7b251cf88 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:01.645266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee788be-c493-4b4e-9ab0-294093238a68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:01.646467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee788be-c493-4b4e-9ab0-294093238a68 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:01.647119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee788be-c493-4b4e-9ab0-294093238a68 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:01.648058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee788be-c493-4b4e-9ab0-294093238a68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:01.665478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee788be-c493-4b4e-9ab0-294093238a68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:01.668211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee788be-c493-4b4e-9ab0-294093238a68 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:01.683290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1178/2327] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:25:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:25:11.500495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=25 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:11.677956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=82 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:24.347419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68518cc1-85bd-46da-b274-81fd1d47dafb None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.347940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68518cc1-85bd-46da-b274-81fd1d47dafb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.347940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68518cc1-85bd-46da-b274-81fd1d47dafb None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.349712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1150/2328] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:25:24.355574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617dad-3888-4953-a260-7a7cecfc21cd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.356084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617dad-3888-4953-a260-7a7cecfc21cd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.365699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617dad-3888-4953-a260-7a7cecfc21cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.377181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ea617dad-3888-4953-a260-7a7cecfc21cd None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:24.378418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ea617dad-3888-4953-a260-7a7cecfc21cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:24.454147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1179/2329] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:25:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:24.467293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68518cc1-85bd-46da-b274-81fd1d47dafb None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:24.468995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-68518cc1-85bd-46da-b274-81fd1d47dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:24.539633 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68518cc1-85bd-46da-b274-81fd1d47dafb None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:24.545888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d447d3-9201-4353-aa10-7bc455193c00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e3e10f9efeb4b908bf3d74ce1eb6a3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:24.546994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d447d3-9201-4353-aa10-7bc455193c00 service glance] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.547502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d447d3-9201-4353-aa10-7bc455193c00 service glance] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.548005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d447d3-9201-4353-aa10-7bc455193c00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.566116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d447d3-9201-4353-aa10-7bc455193c00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:24.568511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d447d3-9201-4353-aa10-7bc455193c00 service glance] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:24.581253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1151/2330] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:25:24.781907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f6df-75b1-4390-bd6c-2064b77cdcb8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.782099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f6df-75b1-4390-bd6c-2064b77cdcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.782391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f6df-75b1-4390-bd6c-2064b77cdcb8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.783808 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1180/2331] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:25:24.789478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930935c-ea09-47f6-8088-807121ec4f88 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.789765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930935c-ea09-47f6-8088-807121ec4f88 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.790086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930935c-ea09-47f6-8088-807121ec4f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.815706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4930935c-ea09-47f6-8088-807121ec4f88 None None] MFA Rules not processed for user `765ee8241c4e448eb999016b17132e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:24.817030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4930935c-ea09-47f6-8088-807121ec4f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:24.824198 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1152/2332] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:25:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:24.837052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f6df-75b1-4390-bd6c-2064b77cdcb8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:24.838936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eba0f6df-75b1-4390-bd6c-2064b77cdcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:24.854941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f6df-75b1-4390-bd6c-2064b77cdcb8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:24.858584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69c24-8aea-4228-9886-ac0336b4e4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:24.859201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69c24-8aea-4228-9886-ac0336b4e4cc service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.859526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69c24-8aea-4228-9886-ac0336b4e4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.861503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69c24-8aea-4228-9886-ac0336b4e4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.870927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69c24-8aea-4228-9886-ac0336b4e4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:24.872368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69c24-8aea-4228-9886-ac0336b4e4cc service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:24.881412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1181/2333] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:24.967081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1766a-2de7-4640-9319-e265c7f2ea68 None None] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.967364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1766a-2de7-4640-9319-e265c7f2ea68 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.967639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1766a-2de7-4640-9319-e265c7f2ea68 None None] PATH_INFO: `/` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.968994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1153/2334] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 17 20:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:25:24.975032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6412aaa-edeb-4433-bea1-dbad93f1fbdd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:24.975322 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6412aaa-edeb-4433-bea1-dbad93f1fbdd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:24.975606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6412aaa-edeb-4433-bea1-dbad93f1fbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:24.997427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c6412aaa-edeb-4433-bea1-dbad93f1fbdd None None] MFA Rules not processed for user `a78694291dba47f1b833c721cb728460`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:24.998826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c6412aaa-edeb-4433-bea1-dbad93f1fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:25.009368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1182/2335] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 17 20:25:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:25.020091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1766a-2de7-4640-9319-e265c7f2ea68 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:25.032339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1766a-2de7-4640-9319-e265c7f2ea68 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:25.036180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:25.037643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:25.037930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:25.038213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:25.049186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:25.051890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:25.062339 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1154/2336] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:32.498914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62985f30-c512-41a6-adf8-f4e139e2e655 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:32.499457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62985f30-c512-41a6-adf8-f4e139e2e655 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:32.499554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62985f30-c512-41a6-adf8-f4e139e2e655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:32.520015 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-62985f30-c512-41a6-adf8-f4e139e2e655 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:32.521692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62985f30-c512-41a6-adf8-f4e139e2e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:32.529042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1183/2337] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:25:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:32.541552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:32.560814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2ea93-420d-47ae-99fa-3e92a74c0b02 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:32.560814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f433-1632-4b7e-ae85-e76e525c3888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:32.560814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f433-1632-4b7e-ae85-e76e525c3888 service swift] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:32.561271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f433-1632-4b7e-ae85-e76e525c3888 service swift] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:32.561271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f433-1632-4b7e-ae85-e76e525c3888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:32.570943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f433-1632-4b7e-ae85-e76e525c3888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:32.573174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f433-1632-4b7e-ae85-e76e525c3888 service swift] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:32.586904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1155/2338] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:25:42.514195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=43 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:42.580642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=41 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:03.284200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400c59-6b97-48ad-9e74-c20c2f9ce2af None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:03.285371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400c59-6b97-48ad-9e74-c20c2f9ce2af None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:03.285371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400c59-6b97-48ad-9e74-c20c2f9ce2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:03.309048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c1400c59-6b97-48ad-9e74-c20c2f9ce2af None None] MFA Rules not processed for user `4e62a4adc12f4963b09b495122c0a6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:03.311367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c1400c59-6b97-48ad-9e74-c20c2f9ce2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:03.384809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1184/2339] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:26:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:26:03.739685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:03.741169 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:03.741778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:03.770480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:03.772572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:03.787445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1156/2340] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 17 20:26:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:03.814442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1400c59-6b97-48ad-9e74-c20c2f9ce2af None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:03.829890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1400c59-6b97-48ad-9e74-c20c2f9ce2af None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:03.838072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:03.838913 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:03.839302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:03.839666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:03.855222 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:03.857902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:03.870832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1185/2341] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:26:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:26:11.572232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:11.573692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:11.587305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adbd0c-99a8-4317-918f-45622c23bd88 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:11.592524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:11.592524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:11.592524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:11.592882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:11.595011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:11.610380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:11.613264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:11.626748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1157/2342] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:26:13.828044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:13.839343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a24d-f753-4d44-a8a7-d9b705c0346d service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:13.843398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:13.844009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:13.844295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:13.847621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:13.847621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:13.861497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:13.864640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:13.881881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1186/2343] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:21.620498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=9 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:23.874235 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=37 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:30.178543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:30.187555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1c81-dd0b-404d-851c-cca5c758d38b service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:30.192137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ca97c-cda4-4cee-bf0e-f02f0696b2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:30.192842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ca97c-cda4-4cee-bf0e-f02f0696b2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:30.193224 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ca97c-cda4-4cee-bf0e-f02f0696b2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:30.193648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ca97c-cda4-4cee-bf0e-f02f0696b2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:30.195782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-284ca97c-cda4-4cee-bf0e-f02f0696b2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:30.256497 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ca97c-cda4-4cee-bf0e-f02f0696b2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:30.257976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ca97c-cda4-4cee-bf0e-f02f0696b2a0 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:30.267203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1158/2344] 10.222.0.64 () {60 vars in 1396 bytes} [Wed Aug 17 20:26:30 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:26:33.313796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:33.315702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:33.385063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548181-15e2-41e1-86df-49ac3474dab5 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:33.389290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:33.390026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:33.390367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:33.390733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:33.392668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:33.459726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:33.461300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:33.472196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1187/2345] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:38.669880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:38.670464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:38.670569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:38.691219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] MFA Rules not processed for user `8cacffb3524f4f8ea97946e5e4af1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:38.695813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:38.699447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1159/2346] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:26:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:43.466990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=48 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:45.568967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:45.585326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98aa58-45df-40a3-a44c-5f23361ecb63 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:45.596677 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43cc23-9c5b-4f5f-ba34-94e85ad06c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:45.596677 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cc23-9c5b-4f5f-ba34-94e85ad06c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:45.596677 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cc23-9c5b-4f5f-ba34-94e85ad06c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:45.596677 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cc23-9c5b-4f5f-ba34-94e85ad06c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:45.597098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2f43cc23-9c5b-4f5f-ba34-94e85ad06c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:45.604568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43cc23-9c5b-4f5f-ba34-94e85ad06c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:45.606107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43cc23-9c5b-4f5f-ba34-94e85ad06c75 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:45.615543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1188/2347] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:47.646563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:47.648017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:47.664563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a875e-9ecd-40ce-a6ad-f8a8ba70bb9c None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:47.669987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:47.670595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:47.670911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:47.671183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:47.672945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:47.687352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:47.689012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:47.701857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1160/2348] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:48.482203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:48.483177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:48.483655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:48.505633 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] MFA Rules not processed for user `acd37d5161b247139f337ef0bf50a764`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:48.506987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:48.515136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1189/2349] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:26:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:48.865168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:48.875989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239bf5-c983-4c38-96cf-7d206a71795a service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:48.881946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:48.882601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:48.883110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:48.884161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:48.886007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:48.897683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:48.899409 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:48.908591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1161/2350] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:49.408208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:49.409922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:49.500504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:49.511494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72714d-4b52-413f-a6a4-567fa4bb18e5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:49.516017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2edb-680b-4f37-988a-24fbbf37b42b service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:49.517258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:49.518487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:49.519010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:49.519298 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:49.521035 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:49.522478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5dd18-bea1-42d5-9c1e-c5554c63af1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:49.523124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dd18-bea1-42d5-9c1e-c5554c63af1d service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:49.523407 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dd18-bea1-42d5-9c1e-c5554c63af1d service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:49.523686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dd18-bea1-42d5-9c1e-c5554c63af1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:49.525434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-28c5dd18-bea1-42d5-9c1e-c5554c63af1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:49.533472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:49.535348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:49.539040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5dd18-bea1-42d5-9c1e-c5554c63af1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:49.540670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5dd18-bea1-42d5-9c1e-c5554c63af1d service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:49.545781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1190/2351] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:49.551770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1162/2352] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:26:59.547070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=41 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:59.547506 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=49 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:02.923778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:02.925956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:02.942820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408824d0-9d25-42e3-9fab-10419d211be4 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:02.950282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331479d2-481a-41de-a5cf-6b8a459796fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:02.956013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331479d2-481a-41de-a5cf-6b8a459796fb service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:02.956013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331479d2-481a-41de-a5cf-6b8a459796fb service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:02.956013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331479d2-481a-41de-a5cf-6b8a459796fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:02.956013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-331479d2-481a-41de-a5cf-6b8a459796fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:02.973267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331479d2-481a-41de-a5cf-6b8a459796fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:02.975375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331479d2-481a-41de-a5cf-6b8a459796fb service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:02.989896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1191/2353] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:12.795117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5507e6f-65f2-45ad-a505-4bc8ab008e35 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:12.796450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5507e6f-65f2-45ad-a505-4bc8ab008e35 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:12.796450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5507e6f-65f2-45ad-a505-4bc8ab008e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:12.816919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f5507e6f-65f2-45ad-a505-4bc8ab008e35 None None] MFA Rules not processed for user `3355014e725048949595575341c69c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:12.818145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f5507e6f-65f2-45ad-a505-4bc8ab008e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:12.886974 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1163/2354] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:12.986063 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:17.552867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:17.553424 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:17.553630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:17.574458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:17.575700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:17.583739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1192/2355] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 17 20:27:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:17.703384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5507e6f-65f2-45ad-a505-4bc8ab008e35 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:17.716778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5507e6f-65f2-45ad-a505-4bc8ab008e35 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:17.722728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:17.723411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:17.723699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:17.723979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:17.733668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:17.735204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:17.744555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1164/2356] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:27:18.946807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:18.948417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:18.966220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9526b-ff35-4509-b71a-a9193f279d45 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:18.973325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:18.974060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:18.974407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:18.974794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:18.976890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:18.991440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:18.993147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:19.008985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1193/2357] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:19.385052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:19.386774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:19.491819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302620a-474d-416a-a3dd-e2222287d407 service swift] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:19.498583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:19.499542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:19.499823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:19.500098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] PATH_INFO: `/v3/users/4e62a4adc12f4963b09b495122c0a6d5` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:19.503047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e62a4adc12f4963b09b495122c0a6d5)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:19.505627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:19.759966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e62a4adc12f4963b09b495122c0a6d5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:19.774095 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e62a4adc12f4963b09b495122c0a6d5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:19.774882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e62a4adc12f4963b09b495122c0a6d5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:19.846650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e62a4adc12f4963b09b495122c0a6d5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:19.847319 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-fece7ff4-2a18-4717-a4e5-8ab551b54936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e62a4adc12f4963b09b495122c0a6d5'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:19.863404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1165/2358] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:27:19 2022] DELETE /identity/v3/users/4e62a4adc12f4963b09b495122c0a6d5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:20.377982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:20.393072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec3b5b-4045-45fa-a99a-c7aeaa1ab261 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:20.487114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:20.487777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:20.488049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:20.488327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] PATH_INFO: `/v3/projects/11fb3890c76b4b60bac49fdcb8dbb71e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:20.489575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fb3890c76b4b60bac49fdcb8dbb71e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:20.491580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:20.605152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fb3890c76b4b60bac49fdcb8dbb71e', 'request_id': 'req-8b8a2db3-459d-4c8f-ad71-302e3c792162'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:20.624290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fb3890c76b4b60bac49fdcb8dbb71e', 'request_id': 'req-8b8a2db3-459d-4c8f-ad71-302e3c792162'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:20.687750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fb3890c76b4b60bac49fdcb8dbb71e', 'request_id': 'req-8b8a2db3-459d-4c8f-ad71-302e3c792162'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:20.702662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] The token cache is being invalidate because project 11fb3890c76b4b60bac49fdcb8dbb71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:27:20.703261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:20.706114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8b8a2db3-459d-4c8f-ad71-302e3c792162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:20.708064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1194/2359] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:27:20 2022] DELETE /identity/v3/projects/11fb3890c76b4b60bac49fdcb8dbb71e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:20.715055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f156e1-aabb-4201-94b1-93d0701934de None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:20.716083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f156e1-aabb-4201-94b1-93d0701934de None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:20.717336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f156e1-aabb-4201-94b1-93d0701934de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:20.750125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-31f156e1-aabb-4201-94b1-93d0701934de None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:20.752645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-31f156e1-aabb-4201-94b1-93d0701934de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:20.760510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:20.871522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1166/2360] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:27:20.881309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efe5d-7bb5-49cf-83a4-5482ee9e7d4b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:20.881596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efe5d-7bb5-49cf-83a4-5482ee9e7d4b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:20.882013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efe5d-7bb5-49cf-83a4-5482ee9e7d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:20.906378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-892efe5d-7bb5-49cf-83a4-5482ee9e7d4b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:20.908233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-892efe5d-7bb5-49cf-83a4-5482ee9e7d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:20.940692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f156e1-aabb-4201-94b1-93d0701934de None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:20.946377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1195/2361] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:20.952835 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f156e1-aabb-4201-94b1-93d0701934de None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:20.959924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:20.960840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:20.961161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:20.961434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:20.962392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:27:20.962737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:20.965383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:20.985168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efe5d-7bb5-49cf-83a4-5482ee9e7d4b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:20.992538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1167/2362] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:27:21.002865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efe5d-7bb5-49cf-83a4-5482ee9e7d4b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:21.013831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:21.015093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:21.015875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:21.016517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:21.018758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:21.021623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:21.142992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1196/2363] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:27:20 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:27:21.147412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:21.160250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5851-24b5-4fac-81fa-6b9ccf41c2bb admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:21.242225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:21.243439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:21.243963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:21.244479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:21.245709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:21.249799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:21.379679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1168/2364] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:27:21 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:27:21.383827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:21.395924 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8788d5c-a878-49e3-9b4b-c0b3a571aac2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:21.408442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:21.409441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:21.409814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:21.410169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:21.410890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:21.412548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:21.425561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1197/2365] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:27:21.430511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:21.443000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13715429-a226-460b-aaee-ff2e7ce4554c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:21.448245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0a05-0c00-4f75-b510-893f582ae5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:21.448978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0a05-0c00-4f75-b510-893f582ae5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:21.449335 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0a05-0c00-4f75-b510-893f582ae5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:21.449684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0a05-0c00-4f75-b510-893f582ae5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:21.450467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a0a05-0c00-4f75-b510-893f582ae5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:21.452180 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a0a05-0c00-4f75-b510-893f582ae5f4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:21.464566 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1169/2366] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:27:21.471894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:21.482791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30b405-86bb-4913-b751-12fdc44daed0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:21.488896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:21.489381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:21.489657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:21.489933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] PATH_INFO: `/v3/projects/695cb2c1990a42b389673d7178e55cbb/users/458788ea9d0c40609e9541eed9aa0c69/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:21.521720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695cb2c1990a42b389673d7178e55cbb, user_id=458788ea9d0c40609e9541eed9aa0c69, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:21.522278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:21.632720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1198/2367] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:27:21 2022] PUT /identity/v3/projects/695cb2c1990a42b389673d7178e55cbb/users/458788ea9d0c40609e9541eed9aa0c69/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:27:21.644110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:21.644738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:21.645127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:21.690174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] MFA Rules not processed for user `458788ea9d0c40609e9541eed9aa0c69`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:21.691945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:21.771800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1170/2368] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:27:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:21.781548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:21.784297 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:21.795372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:21.849755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508987-4d0b-4858-8de8-59b67a1f0ab4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:21.853882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:21.854596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:21.854907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:21.855186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:21.865572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:21.867172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:21.881238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1199/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:23.975721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:23.977413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:23.994799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:24.073419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9e3a6-bbf7-4cec-a9ac-eb8cc721e433 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:24.079562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:24.080403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:24.080686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:24.081146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:24.083184 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:24.097751 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:24.099475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:24.110560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1171/2370] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:29.645375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:29.647682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:29.726637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4567c-e948-4265-a6cb-d38485803ac4 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:29.731507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:29.732134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:29.732416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:29.732689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] PATH_INFO: `/v3/users/d8e620b4ca454bc5a6a19ae55138d861` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:29.733854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e620b4ca454bc5a6a19ae55138d861)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:29.736356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:29.927042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e620b4ca454bc5a6a19ae55138d861'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:29.940535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e620b4ca454bc5a6a19ae55138d861'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:29.947588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e620b4ca454bc5a6a19ae55138d861'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:29.948452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e620b4ca454bc5a6a19ae55138d861'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:30.018871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e620b4ca454bc5a6a19ae55138d861'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:30.026177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1200/2371] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:27:29 2022] DELETE /identity/v3/users/d8e620b4ca454bc5a6a19ae55138d861 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:30.318012 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:30.333657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165450a-5b11-438f-aa19-d2a017f603f6 service placement] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:30.434056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:30.434250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:30.442148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:30.442148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] PATH_INFO: `/v3/projects/6f2054a9c9ff437c8aceef06d0043526` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:30.442148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2054a9c9ff437c8aceef06d0043526)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:30.443837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:30.573368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2054a9c9ff437c8aceef06d0043526', 'request_id': 'req-6abb8315-32a0-4b19-a15f-00275f19d330'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:30.579665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2054a9c9ff437c8aceef06d0043526', 'request_id': 'req-6abb8315-32a0-4b19-a15f-00275f19d330'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:30.652934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2054a9c9ff437c8aceef06d0043526', 'request_id': 'req-6abb8315-32a0-4b19-a15f-00275f19d330'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:30.665746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] The token cache is being invalidate because project 6f2054a9c9ff437c8aceef06d0043526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:27:30.666041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:30.666994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:30.668767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1172/2372] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:27:30 2022] DELETE /identity/v3/projects/6f2054a9c9ff437c8aceef06d0043526 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:30.673057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:30.674662 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:30.688976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25333290-d9f3-4b58-b57e-b2b798dea8c8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:30.716969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:30.750206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:30.751398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:30.751681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:30.751960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] PATH_INFO: `/v3/users/3295a79391ea466d9d8b9c41a806fbf3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:30.753306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3295a79391ea466d9d8b9c41a806fbf3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:30.755343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:31.034829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3295a79391ea466d9d8b9c41a806fbf3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.049599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3295a79391ea466d9d8b9c41a806fbf3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.057506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3295a79391ea466d9d8b9c41a806fbf3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.057973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3295a79391ea466d9d8b9c41a806fbf3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.138518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3295a79391ea466d9d8b9c41a806fbf3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.145795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1201/2373] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:27:30 2022] DELETE /identity/v3/users/3295a79391ea466d9d8b9c41a806fbf3 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:31.475093 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:31.476657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:31.491514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb8315-32a0-4b19-a15f-00275f19d330 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:31.541426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:31.594269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:31.594948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:31.595231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:31.595515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] PATH_INFO: `/v3/projects/d4a1b62c333644edb4ab576c7c3f530c` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:31.596810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a1b62c333644edb4ab576c7c3f530c)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:31.598930 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:31.739027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a1b62c333644edb4ab576c7c3f530c', 'request_id': 'req-5deffc8e-4192-44ed-92b2-1726913a8d51'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.745445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a1b62c333644edb4ab576c7c3f530c', 'request_id': 'req-5deffc8e-4192-44ed-92b2-1726913a8d51'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.824882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a1b62c333644edb4ab576c7c3f530c', 'request_id': 'req-5deffc8e-4192-44ed-92b2-1726913a8d51'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.846494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] The token cache is being invalidate because project d4a1b62c333644edb4ab576c7c3f530c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:27:31.846818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.847586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5deffc8e-4192-44ed-92b2-1726913a8d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:31.849215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1173/2374] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:27:31 2022] DELETE /identity/v3/projects/d4a1b62c333644edb4ab576c7c3f530c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:41.141994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:41.840736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:43.968690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:43.971147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:44.081417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c9107-2550-4473-ade4-2813a135d79e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:44.214135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:44.214823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:44.215109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:44.217660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] PATH_INFO: `/v3/users/458788ea9d0c40609e9541eed9aa0c69` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:44.217660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=458788ea9d0c40609e9541eed9aa0c69)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:44.219402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:44.504002 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458788ea9d0c40609e9541eed9aa0c69'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:44.526512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458788ea9d0c40609e9541eed9aa0c69'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:44.535557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458788ea9d0c40609e9541eed9aa0c69'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:44.536250 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458788ea9d0c40609e9541eed9aa0c69'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:44.641763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458788ea9d0c40609e9541eed9aa0c69'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:44.649013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1202/2375] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:27:43 2022] DELETE /identity/v3/users/458788ea9d0c40609e9541eed9aa0c69 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:44.653810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:44.654347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:44.654347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:44.697112 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:44.702507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:44.771317 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1174/2376] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:44.782611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:44.784193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:44.809988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:44.903600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6772c7-9a02-4fba-a842-39e1c1deee17 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:44.909880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:44.910528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:44.910852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:44.911133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:44.928571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:44.930814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:44.945258 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1203/2377] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:45.661058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:45.662607 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:45.677264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8eead-61a8-47a2-a657-712d8ea6bd58 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:45.683090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:45.683740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:45.684142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:45.685196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] PATH_INFO: `/v3/projects/695cb2c1990a42b389673d7178e55cbb` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:45.686702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] RBAC: Authorizing `identity:delete_project(project_id=695cb2c1990a42b389673d7178e55cbb)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:45.691536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:45.842550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695cb2c1990a42b389673d7178e55cbb', 'request_id': 'req-03283298-df74-49af-bc25-9c26fa09007e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:45.850534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695cb2c1990a42b389673d7178e55cbb', 'request_id': 'req-03283298-df74-49af-bc25-9c26fa09007e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:45.965767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695cb2c1990a42b389673d7178e55cbb', 'request_id': 'req-03283298-df74-49af-bc25-9c26fa09007e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:45.977827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] The token cache is being invalidate because project 695cb2c1990a42b389673d7178e55cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:27:45.978125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:45.978812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:45.980291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1175/2378] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:27:45 2022] DELETE /identity/v3/projects/695cb2c1990a42b389673d7178e55cbb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:54.938829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=34 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:55.974726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:01.292123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:01.303025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7f814-d13d-4395-9dc5-a66eb9827332 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:01.362867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:01.363545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:01.364077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:01.364368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:01.366492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:01.469381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:01.470839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:01.495237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1204/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:06.151673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:06.153626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:06.169414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03283298-df74-49af-bc25-9c26fa09007e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:06.176059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:06.176910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:06.177267 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:06.177550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] PATH_INFO: `/v3/users/8cacffb3524f4f8ea97946e5e4af1ac3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:06.178854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cacffb3524f4f8ea97946e5e4af1ac3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:06.180870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:06.476000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cacffb3524f4f8ea97946e5e4af1ac3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:06.490028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cacffb3524f4f8ea97946e5e4af1ac3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:06.491505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cacffb3524f4f8ea97946e5e4af1ac3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:06.577948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cacffb3524f4f8ea97946e5e4af1ac3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:06.578670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7430b0a5-a2eb-4227-b5d7-f34df674594b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cacffb3524f4f8ea97946e5e4af1ac3'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:06.595963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1176/2380] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:06 2022] DELETE /identity/v3/users/8cacffb3524f4f8ea97946e5e4af1ac3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:06.900971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:06.913378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6dee2-b4ef-4bcc-b6a2-02c69a77c6a0 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:06.988236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:06.988891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:06.989163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:06.989435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] PATH_INFO: `/v3/projects/489cb30d561c4b6591f8cf6fb74e1ee3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:06.990664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489cb30d561c4b6591f8cf6fb74e1ee3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:06.997249 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:07.103966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489cb30d561c4b6591f8cf6fb74e1ee3', 'request_id': 'req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:07.105979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:07.110147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489cb30d561c4b6591f8cf6fb74e1ee3', 'request_id': 'req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:07.194286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489cb30d561c4b6591f8cf6fb74e1ee3', 'request_id': 'req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:07.208638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] The token cache is being invalidate because project 489cb30d561c4b6591f8cf6fb74e1ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:07.208971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:07.209718 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ea537a6-9c8c-4ceb-9a35-c21751c5a4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:07.211324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1205/2381] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:06 2022] DELETE /identity/v3/projects/489cb30d561c4b6591f8cf6fb74e1ee3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:07.216588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c496-4b77-43b7-8975-49a4964f5ee9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.217135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c496-4b77-43b7-8975-49a4964f5ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.217135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c496-4b77-43b7-8975-49a4964f5ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.283684 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-9795c496-4b77-43b7-8975-49a4964f5ee9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:07.285162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9795c496-4b77-43b7-8975-49a4964f5ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:07.363389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1177/2382] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:07.376246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9d5ea-b1dd-4658-a9b3-19832c0e46c9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.376531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9d5ea-b1dd-4658-a9b3-19832c0e46c9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.376807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9d5ea-b1dd-4658-a9b3-19832c0e46c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.398877 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d2c9d5ea-b1dd-4658-a9b3-19832c0e46c9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:07.402382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2c9d5ea-b1dd-4658-a9b3-19832c0e46c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:07.411774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1206/2383] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:07.417447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795c496-4b77-43b7-8975-49a4964f5ee9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:07.435541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795c496-4b77-43b7-8975-49a4964f5ee9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:07.445120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:07.446034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.446492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.446992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.448089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:07.448576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:07.451511 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:07.477190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1178/2384] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:28:07.481865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9d5ea-b1dd-4658-a9b3-19832c0e46c9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:07.493167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9d5ea-b1dd-4658-a9b3-19832c0e46c9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:07.498596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:07.499255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.499537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.499813 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.500466 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:07.503343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:07.616552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1207/2385] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:07 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:07.621631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:07.633604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be91c98-3760-41af-aefc-768a6f81462c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:07.673484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:07.724245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:07.724489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.725124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.725611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.726805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:07.729924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:07.859088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1179/2386] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:07 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:07.864379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:07.876343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c352521-6313-4a6a-8beb-048d033fe85a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:07.882427 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:07.883256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.883534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.884033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.885348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:07.887038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:07.901115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1208/2387] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:07.907527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:07.919304 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d814-b462-44a8-8c61-a34370cf03e3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:07.925155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b80c8a-6ecc-40d6-9f3b-c5d832106980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:07.925900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80c8a-6ecc-40d6-9f3b-c5d832106980 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.926272 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80c8a-6ecc-40d6-9f3b-c5d832106980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.926673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80c8a-6ecc-40d6-9f3b-c5d832106980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.927483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b80c8a-6ecc-40d6-9f3b-c5d832106980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:07.935237 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b80c8a-6ecc-40d6-9f3b-c5d832106980 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:07.940689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1180/2388] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:07.946162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:07.962151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653017-63ed-4d9a-a960-d6090eda2c88 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:07.968155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:07.968842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:07.969045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:07.969382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] PATH_INFO: `/v3/projects/22127d47dd564d218b2108bf053106e1/users/59fe521f5b1c45e58267bfb8ba407496/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:07.989502 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=22127d47dd564d218b2108bf053106e1, user_id=59fe521f5b1c45e58267bfb8ba407496, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:07.993278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:08.099037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1209/2389] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:07 2022] PUT /identity/v3/projects/22127d47dd564d218b2108bf053106e1/users/59fe521f5b1c45e58267bfb8ba407496/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:08.110411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674a9db-1bf2-4bdc-9ce7-e7002c4d565b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:08.110732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674a9db-1bf2-4bdc-9ce7-e7002c4d565b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:08.111009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674a9db-1bf2-4bdc-9ce7-e7002c4d565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:08.145395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e674a9db-1bf2-4bdc-9ce7-e7002c4d565b None None] MFA Rules not processed for user `59fe521f5b1c45e58267bfb8ba407496`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:08.146645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e674a9db-1bf2-4bdc-9ce7-e7002c4d565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:08.217520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1181/2390] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:08.230223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:08.231942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:08.313801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98549881-da4c-46b0-b1a5-86c1f36865bd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:08.320220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ee89-9246-4692-852f-8de041a9f70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:08.320843 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ee89-9246-4692-852f-8de041a9f70d service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:08.321131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ee89-9246-4692-852f-8de041a9f70d service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:08.321410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ee89-9246-4692-852f-8de041a9f70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:08.330166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ee89-9246-4692-852f-8de041a9f70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:08.331855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ee89-9246-4692-852f-8de041a9f70d service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:08.342153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1210/2391] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:12.037450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674a9db-1bf2-4bdc-9ce7-e7002c4d565b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:12.138986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674a9db-1bf2-4bdc-9ce7-e7002c4d565b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:12.144598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:12.145934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:12.146233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:12.146512 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] PATH_INFO: `/v3/users/59fe521f5b1c45e58267bfb8ba407496` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:12.147956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fe521f5b1c45e58267bfb8ba407496)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:12.150027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:12.372117 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:12.374915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fe521f5b1c45e58267bfb8ba407496'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:12.390525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fe521f5b1c45e58267bfb8ba407496'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:12.391464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fe521f5b1c45e58267bfb8ba407496'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:12.498053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fe521f5b1c45e58267bfb8ba407496'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:12.498732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fe521f5b1c45e58267bfb8ba407496'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:12.512476 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1182/2392] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:12 2022] DELETE /identity/v3/users/59fe521f5b1c45e58267bfb8ba407496 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:28:12.517082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:12.517663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:12.517663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:12.538571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:12.540658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:12.592929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:12.607409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1211/2393] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:12.618251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:12.619971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:12.691121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a19c-3609-4c1a-9b7e-f893c861ffc2 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:12.695690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6435a8-4cd9-470c-ae36-4163f391e30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:12.696479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6435a8-4cd9-470c-ae36-4163f391e30f service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:12.696806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6435a8-4cd9-470c-ae36-4163f391e30f service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:12.697185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6435a8-4cd9-470c-ae36-4163f391e30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:12.708760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6435a8-4cd9-470c-ae36-4163f391e30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:12.710234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6435a8-4cd9-470c-ae36-4163f391e30f service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:12.722142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1183/2394] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:13.193876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:13.195434 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:13.209327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103811a-4562-420e-aa51-6ec4c1bb6d21 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:13.214750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:13.215443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:13.215734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:13.216018 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] PATH_INFO: `/v3/projects/22127d47dd564d218b2108bf053106e1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:13.217265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22127d47dd564d218b2108bf053106e1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:13.219350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:13.402107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22127d47dd564d218b2108bf053106e1', 'request_id': 'req-705a38b8-1236-49ee-b5f1-86a9b73fe98d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:13.411896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22127d47dd564d218b2108bf053106e1', 'request_id': 'req-705a38b8-1236-49ee-b5f1-86a9b73fe98d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:13.509119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22127d47dd564d218b2108bf053106e1', 'request_id': 'req-705a38b8-1236-49ee-b5f1-86a9b73fe98d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:13.522552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] The token cache is being invalidate because project 22127d47dd564d218b2108bf053106e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:13.523270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:13.523876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-705a38b8-1236-49ee-b5f1-86a9b73fe98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:13.526491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1212/2395] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:13 2022] DELETE /identity/v3/projects/22127d47dd564d218b2108bf053106e1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:13.531859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350e7c-c3b7-4e74-b015-e511bee2c75e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:13.532477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350e7c-c3b7-4e74-b015-e511bee2c75e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:13.532879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350e7c-c3b7-4e74-b015-e511bee2c75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:13.559479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-55350e7c-c3b7-4e74-b015-e511bee2c75e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:13.561685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-55350e7c-c3b7-4e74-b015-e511bee2c75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:13.637519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1184/2396] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:13.655028 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c6215-6352-4f41-abbe-e2d96ad30b4d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:13.655313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c6215-6352-4f41-abbe-e2d96ad30b4d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:13.655685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c6215-6352-4f41-abbe-e2d96ad30b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:13.678343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8a8c6215-6352-4f41-abbe-e2d96ad30b4d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:13.679629 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8a8c6215-6352-4f41-abbe-e2d96ad30b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:13.688738 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1213/2397] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:13.696394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55350e7c-c3b7-4e74-b015-e511bee2c75e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:13.712555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55350e7c-c3b7-4e74-b015-e511bee2c75e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:13.717480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:13.718104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:13.718412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:13.718718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:13.719402 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:13.719693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:13.721369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:13.734269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1185/2398] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:28:13.739477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c6215-6352-4f41-abbe-e2d96ad30b4d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:13.749794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c6215-6352-4f41-abbe-e2d96ad30b4d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:13.755547 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:13.756178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:13.756469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:13.756749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:13.757422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:13.759510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:13.857703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1214/2399] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:13 2022] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:13.859447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:13.870583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4f96-4b60-46ce-b03d-8a6003f775aa admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:13.925981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:13.935595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:13.936482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:13.938878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:13.938878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:13.938878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:13.940243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:14.065564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1186/2400] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:13 2022] POST /identity/v3/users => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:14.070585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:14.081506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883370db-1948-4d72-809b-5e4d5f5c2dad admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:14.086880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:14.087758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.088117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.088443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.089200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:14.091117 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:14.102582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1215/2401] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:14.107448 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:14.119746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca32c6-aa07-4305-99c2-5213f1342c2e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:14.125021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9899d-d37a-428d-9772-10683f7dbcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:14.125648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9899d-d37a-428d-9772-10683f7dbcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.125927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9899d-d37a-428d-9772-10683f7dbcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.126207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9899d-d37a-428d-9772-10683f7dbcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.126879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9899d-d37a-428d-9772-10683f7dbcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:14.129554 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9899d-d37a-428d-9772-10683f7dbcb6 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:14.141888 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1187/2402] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:14.146961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:14.158398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67ab95-bb4f-4e88-84ed-f056bb3209db admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:14.163868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:14.164552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.164852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.165166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] PATH_INFO: `/v3/projects/ec3c32148d57434c96e2f33de698becb/users/2a409e91b6284bdf96f2480f50856851/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.184065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3c32148d57434c96e2f33de698becb, user_id=2a409e91b6284bdf96f2480f50856851, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:14.186768 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:14.276059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1216/2403] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:14 2022] PUT /identity/v3/projects/ec3c32148d57434c96e2f33de698becb/users/2a409e91b6284bdf96f2480f50856851/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:14.291212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174fd39-91f1-49f6-817e-24331efb9b2f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.291487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174fd39-91f1-49f6-817e-24331efb9b2f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.291785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174fd39-91f1-49f6-817e-24331efb9b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.329124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a174fd39-91f1-49f6-817e-24331efb9b2f None None] MFA Rules not processed for user `2a409e91b6284bdf96f2480f50856851`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:14.331107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a174fd39-91f1-49f6-817e-24331efb9b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:14.407293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1188/2404] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:14.412691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:14.487830 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1bd96-7859-4f19-a387-d05ce7912477 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:14.493037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:14.493849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.494137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.494418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.495116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:14.497241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:14.596420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:14.604022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1217/2405] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:14 2022] POST /identity/v3/projects => generated 405 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:14.608299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174fd39-91f1-49f6-817e-24331efb9b2f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:14.620203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174fd39-91f1-49f6-817e-24331efb9b2f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:14.700104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:14.700724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.701008 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.701291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.701934 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:14.703957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:14.853849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1189/2406] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:14 2022] POST /identity/v3/users => generated 309 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:14.858026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:14.869233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab4ecc-d679-4d13-a375-59db37e267b9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:14.875227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:14.876630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.877044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.877550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.878814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:14.880485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:14.894609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1218/2407] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:14.899096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:14.910384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395363d2-1793-4f9d-bc3d-f2b4f2021bf2 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:14.915574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:14.916266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:14.916553 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:14.916835 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] PATH_INFO: `/v3/projects/5461265508b44ee995c675f58ade835a/users/2c10aadd522b479aa8238d2b84bfc910/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:14.935234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5461265508b44ee995c675f58ade835a, user_id=2c10aadd522b479aa8238d2b84bfc910, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:14.937944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:15.024502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1190/2408] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:14 2022] PUT /identity/v3/projects/5461265508b44ee995c675f58ade835a/users/2c10aadd522b479aa8238d2b84bfc910/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:15.028871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:15.039942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0480-e40a-4d2a-91a9-901b2e56005e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:15.102399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6b039-45eb-4372-a522-8875be4b7bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:15.103686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6b039-45eb-4372-a522-8875be4b7bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:15.104295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6b039-45eb-4372-a522-8875be4b7bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:15.104749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6b039-45eb-4372-a522-8875be4b7bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:15.105957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6b039-45eb-4372-a522-8875be4b7bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:15.109144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6b039-45eb-4372-a522-8875be4b7bf9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:15.128696 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1219/2409] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:15.133143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:15.144661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffef4-7693-43bb-b6cf-57b783dc455b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:15.149638 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:15.150318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:15.150601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:15.150925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] PATH_INFO: `/v3/projects/5461265508b44ee995c675f58ade835a/users/2c10aadd522b479aa8238d2b84bfc910/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:15.152871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5461265508b44ee995c675f58ade835a, user_id=2c10aadd522b479aa8238d2b84bfc910, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:15.155571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:15.167468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1191/2410] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:15 2022] PUT /identity/v3/projects/5461265508b44ee995c675f58ade835a/users/2c10aadd522b479aa8238d2b84bfc910/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:15.179417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5089f-7ff8-406c-96aa-372e964612f7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:15.179699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5089f-7ff8-406c-96aa-372e964612f7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:15.179978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5089f-7ff8-406c-96aa-372e964612f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:15.211223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-aba5089f-7ff8-406c-96aa-372e964612f7 None None] MFA Rules not processed for user `2c10aadd522b479aa8238d2b84bfc910`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:15.212472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aba5089f-7ff8-406c-96aa-372e964612f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:15.289991 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1220/2411] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:15.303844 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:15.305670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:15.327114 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:15.395658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9f447-2ecb-4bb1-8324-23473d499a9d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:15.399385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:15.400003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:15.400285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:15.400561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:15.410348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:15.411834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:15.422806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1192/2412] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:15 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:15.592700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5089f-7ff8-406c-96aa-372e964612f7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:15.670505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5089f-7ff8-406c-96aa-372e964612f7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:15.678415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:15.679412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:15.679849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:15.680251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] PATH_INFO: `/v3/users/2a409e91b6284bdf96f2480f50856851` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:15.681829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a409e91b6284bdf96f2480f50856851)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:15.696208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:15.698234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:15.932370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a409e91b6284bdf96f2480f50856851'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:15.945904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a409e91b6284bdf96f2480f50856851'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:15.955302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a409e91b6284bdf96f2480f50856851'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:15.956131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a409e91b6284bdf96f2480f50856851'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:16.002330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:16.003859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:16.063948 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9da7ea81-fa81-4570-a879-3eddd6cba2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a409e91b6284bdf96f2480f50856851'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:16.075554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1221/2413] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:15 2022] DELETE /identity/v3/users/2a409e91b6284bdf96f2480f50856851 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:16.082783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:16.082783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:16.082783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:16.102501 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42629942-ff39-44a7-904b-8d14ce235327 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:16.103198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:16.104365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:16.185857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:16.186426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:16.190028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:16.190246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1222/2414] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:16.190350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:16.192449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:16.197512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:16.198960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:16.233797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:16.265568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3d634-b8c9-45d7-bed4-0d644673d427 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:16.267910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:16.270077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:16.270252 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:16.270910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:16.271190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:16.271469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:16.281404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1193/2415] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:16.285841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:16.285841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:16.295807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1223/2416] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:28:16.840731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:16.843127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:16.871630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c437b-aa7a-463b-835b-6d6042bcdbf3 service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:16.887833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:16.891142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:16.891142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:16.891142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] PATH_INFO: `/v3/projects/ec3c32148d57434c96e2f33de698becb` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:16.891142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3c32148d57434c96e2f33de698becb)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:16.894250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:17.076307 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3c32148d57434c96e2f33de698becb', 'request_id': 'req-38979ae8-56aa-44a5-a46a-c4caf43c393a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.086133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3c32148d57434c96e2f33de698becb', 'request_id': 'req-38979ae8-56aa-44a5-a46a-c4caf43c393a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.177699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3c32148d57434c96e2f33de698becb', 'request_id': 'req-38979ae8-56aa-44a5-a46a-c4caf43c393a'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.192439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] The token cache is being invalidate because project ec3c32148d57434c96e2f33de698becb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:17.192874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.193747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.195483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1194/2417] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:16 2022] DELETE /identity/v3/projects/ec3c32148d57434c96e2f33de698becb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:17.199821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:17.210889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f78b-0d0c-45e6-82ad-670e09aa8bc7 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:17.245659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:17.277891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:17.278567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:17.278927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:17.279215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] PATH_INFO: `/v3/users/2c10aadd522b479aa8238d2b84bfc910` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:17.280417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c10aadd522b479aa8238d2b84bfc910)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:17.282374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:17.540832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c10aadd522b479aa8238d2b84bfc910'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.553690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c10aadd522b479aa8238d2b84bfc910'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.562359 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c10aadd522b479aa8238d2b84bfc910'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.563219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c10aadd522b479aa8238d2b84bfc910'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.669575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-686aed0d-196e-42cc-9758-1d8ed5de4feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c10aadd522b479aa8238d2b84bfc910'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:17.677030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1224/2418] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:17 2022] DELETE /identity/v3/users/2c10aadd522b479aa8238d2b84bfc910 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:18.197292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:18.199065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:18.222505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979ae8-56aa-44a5-a46a-c4caf43c393a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:18.295627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:18.296282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:18.296563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:18.296835 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] PATH_INFO: `/v3/projects/5461265508b44ee995c675f58ade835a` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:18.298058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5461265508b44ee995c675f58ade835a)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:18.301619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:18.431483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5461265508b44ee995c675f58ade835a', 'request_id': 'req-ce60eced-42a8-4c91-b86b-77d4e5621ddd'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:18.437378 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:18.439890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5461265508b44ee995c675f58ade835a', 'request_id': 'req-ce60eced-42a8-4c91-b86b-77d4e5621ddd'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:18.515250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5461265508b44ee995c675f58ade835a', 'request_id': 'req-ce60eced-42a8-4c91-b86b-77d4e5621ddd'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:18.529627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] The token cache is being invalidate because project 5461265508b44ee995c675f58ade835a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:18.529920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:18.530663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ce60eced-42a8-4c91-b86b-77d4e5621ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:18.532235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1195/2419] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:18 2022] DELETE /identity/v3/projects/5461265508b44ee995c675f58ade835a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:28:18.537777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65f71-5214-4132-963b-2a12de54860c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:18.538397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65f71-5214-4132-963b-2a12de54860c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:18.538397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65f71-5214-4132-963b-2a12de54860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:18.560919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-61b65f71-5214-4132-963b-2a12de54860c None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:18.562191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-61b65f71-5214-4132-963b-2a12de54860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:18.639476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1225/2420] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:18.647884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61524e8-eec5-4a4f-a115-07b746dd25f1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:18.648167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61524e8-eec5-4a4f-a115-07b746dd25f1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:18.648440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61524e8-eec5-4a4f-a115-07b746dd25f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:18.670001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f61524e8-eec5-4a4f-a115-07b746dd25f1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:18.671727 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f61524e8-eec5-4a4f-a115-07b746dd25f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:18.682067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1196/2421] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:18.686928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b65f71-5214-4132-963b-2a12de54860c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:18.699485 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b65f71-5214-4132-963b-2a12de54860c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:18.707310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:18.708317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:18.708757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:18.709202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:18.710365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:18.710901 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:18.713820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:18.736731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1226/2422] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:28:18.741655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61524e8-eec5-4a4f-a115-07b746dd25f1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:18.751812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61524e8-eec5-4a4f-a115-07b746dd25f1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:18.759804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:18.760523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:18.760821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:18.761185 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:18.762404 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:18.766201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:18.879586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1197/2423] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:18 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:18.884389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:18.895781 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dac36-f5d9-465e-a5a4-93aaa54911ea admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:18.936698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:18.967922 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:18.968537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:18.968821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:18.969101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:18.969767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:18.972069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:19.112872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1227/2424] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:18 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:19.117240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:19.130490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50e329-00a7-4691-a8ea-0a1140fd2a37 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:19.135709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:19.136656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:19.137040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:19.137410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:19.138174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:19.140358 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:19.153728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1198/2425] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:19.165970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:19.178343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac803-5341-4a82-ae0c-3d911da128ae admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:19.183676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3c254-f8f6-427c-9f08-3f831fe8500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:19.184313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3c254-f8f6-427c-9f08-3f831fe8500a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:19.184590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3c254-f8f6-427c-9f08-3f831fe8500a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:19.184872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3c254-f8f6-427c-9f08-3f831fe8500a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:19.185527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3c254-f8f6-427c-9f08-3f831fe8500a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:19.187405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3c254-f8f6-427c-9f08-3f831fe8500a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:19.203355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1228/2426] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:19.209251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:19.227289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e57c-cb5e-474a-b864-44b4ea55b088 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:19.235491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:19.236719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:19.242857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:19.242857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] PATH_INFO: `/v3/projects/dd79e1d443034764ba0a6e1ac91213c3/users/c02a7a81bf3a4a3f898deb307a969e8b/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:19.258764 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd79e1d443034764ba0a6e1ac91213c3, user_id=c02a7a81bf3a4a3f898deb307a969e8b, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:19.261585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:19.370126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1199/2427] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:19 2022] PUT /identity/v3/projects/dd79e1d443034764ba0a6e1ac91213c3/users/c02a7a81bf3a4a3f898deb307a969e8b/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:19.383854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af982e5-f11b-430d-a1c8-e9b8680f2b6e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:19.384275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af982e5-f11b-430d-a1c8-e9b8680f2b6e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:19.384733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af982e5-f11b-430d-a1c8-e9b8680f2b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:19.418486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6af982e5-f11b-430d-a1c8-e9b8680f2b6e None None] MFA Rules not processed for user `c02a7a81bf3a4a3f898deb307a969e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:19.419805 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6af982e5-f11b-430d-a1c8-e9b8680f2b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:19.521395 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1229/2428] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:19.530540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:19.643173 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748d78-490b-4a65-abe9-51397464db4f admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:19.648433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:19.649068 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:19.649364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:19.649637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:19.650287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:19.652303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:19.792150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1200/2429] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:19 2022] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:19.797092 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af982e5-f11b-430d-a1c8-e9b8680f2b6e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:19.819055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af982e5-f11b-430d-a1c8-e9b8680f2b6e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:19.904564 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:19.905621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:19.906113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:19.906601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:19.907835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:19.912611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:20.013539 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1230/2430] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:19 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:20.018742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:20.029713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e82a68-df83-474e-b024-c8abaeacfd89 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:20.034685 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:20.037604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:20.037604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:20.037604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:20.037604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:20.038248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:20.051866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1201/2431] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:20.056132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:20.067617 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d38368-2972-4084-89f1-9a489be92ffe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:20.072613 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:20.073311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:20.073595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:20.073876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] PATH_INFO: `/v3/projects/b7e5090dadb144579bc96fa9fca6b33f/users/2369a24f9e5d47559be435600a305938/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:20.091294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e5090dadb144579bc96fa9fca6b33f, user_id=2369a24f9e5d47559be435600a305938, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:20.094065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:20.184703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1231/2432] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:20 2022] PUT /identity/v3/projects/b7e5090dadb144579bc96fa9fca6b33f/users/2369a24f9e5d47559be435600a305938/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:20.191037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:20.201618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1706-9832-4f5c-aed2-5e88574ed1fa admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:20.268356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:20.277246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af368ea-4007-4c75-b284-33fc9d8bdb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:20.282401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af368ea-4007-4c75-b284-33fc9d8bdb0d admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:20.282401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af368ea-4007-4c75-b284-33fc9d8bdb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:20.282401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af368ea-4007-4c75-b284-33fc9d8bdb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:20.282401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af368ea-4007-4c75-b284-33fc9d8bdb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:20.282401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af368ea-4007-4c75-b284-33fc9d8bdb0d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:20.292984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1202/2433] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:20.298163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:20.317461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d7dc-f7f2-4f79-8988-fa4fef9f3c3f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:20.325152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:20.326882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:20.327314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:20.327650 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] PATH_INFO: `/v3/projects/b7e5090dadb144579bc96fa9fca6b33f/users/2369a24f9e5d47559be435600a305938/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:20.330853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e5090dadb144579bc96fa9fca6b33f, user_id=2369a24f9e5d47559be435600a305938, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:20.333890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:20.340570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:20.347182 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1232/2434] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:20 2022] PUT /identity/v3/projects/b7e5090dadb144579bc96fa9fca6b33f/users/2369a24f9e5d47559be435600a305938/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:20.359886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad57c9-1853-4b38-83f4-7e38aa87a863 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:20.360235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad57c9-1853-4b38-83f4-7e38aa87a863 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:20.360521 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad57c9-1853-4b38-83f4-7e38aa87a863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:20.393081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-fdad57c9-1853-4b38-83f4-7e38aa87a863 None None] MFA Rules not processed for user `2369a24f9e5d47559be435600a305938`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:20.394431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fdad57c9-1853-4b38-83f4-7e38aa87a863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:20.480884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1203/2435] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:20.494620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:20.497801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:20.572506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a529-7816-4200-b2a4-331066b2c43d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:20.576690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d4c5-c125-4445-90b0-06eb19b31bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:20.577319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d4c5-c125-4445-90b0-06eb19b31bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:20.577607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d4c5-c125-4445-90b0-06eb19b31bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:20.577919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d4c5-c125-4445-90b0-06eb19b31bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:20.589561 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d4c5-c125-4445-90b0-06eb19b31bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:20.591120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d4c5-c125-4445-90b0-06eb19b31bd8 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:20.602615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1233/2436] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:20.637489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad57c9-1853-4b38-83f4-7e38aa87a863 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:20.751181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad57c9-1853-4b38-83f4-7e38aa87a863 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:20.757847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:20.758507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:20.758820 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:20.759097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] PATH_INFO: `/v3/users/c02a7a81bf3a4a3f898deb307a969e8b` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:20.760311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02a7a81bf3a4a3f898deb307a969e8b)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:20.762256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:21.024156 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02a7a81bf3a4a3f898deb307a969e8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:21.041030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02a7a81bf3a4a3f898deb307a969e8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:21.041842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02a7a81bf3a4a3f898deb307a969e8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:21.156131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02a7a81bf3a4a3f898deb307a969e8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:21.156889 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02a7a81bf3a4a3f898deb307a969e8b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:21.168208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:21.183366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1204/2437] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:20 2022] DELETE /identity/v3/users/c02a7a81bf3a4a3f898deb307a969e8b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:21.368510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:21.369106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:21.369442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:21.399780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:21.400990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:21.477155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1234/2438] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:21.488843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:21.491668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:21.577768 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b21d7d-a199-44f1-b827-9b99c6ce9d28 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:21.582350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:21.583038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:21.583392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:21.583689 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:21.594088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:21.596264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:21.614533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1205/2439] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:22.223674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:22.225374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:22.243062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6e44b-eb49-4e8b-aaa0-089d6443a187 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:22.254972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:22.256091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:22.256577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:22.257022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] PATH_INFO: `/v3/projects/dd79e1d443034764ba0a6e1ac91213c3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:22.258651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd79e1d443034764ba0a6e1ac91213c3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:22.261195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:22.426341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd79e1d443034764ba0a6e1ac91213c3', 'request_id': 'req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.435791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd79e1d443034764ba0a6e1ac91213c3', 'request_id': 'req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.492300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd79e1d443034764ba0a6e1ac91213c3', 'request_id': 'req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.505773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] The token cache is being invalidate because project dd79e1d443034764ba0a6e1ac91213c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:22.506206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.507145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.508876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1235/2440] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:22 2022] DELETE /identity/v3/projects/dd79e1d443034764ba0a6e1ac91213c3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:22.513573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:22.524818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0d8b8-e3e2-46c3-a8ae-aa93e0f40257 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:22.590808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:22.591468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:22.591749 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:22.592024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] PATH_INFO: `/v3/users/2369a24f9e5d47559be435600a305938` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:22.593223 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2369a24f9e5d47559be435600a305938)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:22.595235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:22.829671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2369a24f9e5d47559be435600a305938'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.842474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2369a24f9e5d47559be435600a305938'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.843275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2369a24f9e5d47559be435600a305938'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.920611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2369a24f9e5d47559be435600a305938'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.921388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1f70aa40-1fa0-4e7a-874d-b4c64d20b70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2369a24f9e5d47559be435600a305938'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:22.935817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1206/2441] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:22 2022] DELETE /identity/v3/users/2369a24f9e5d47559be435600a305938 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:23.410262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:23.411904 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:23.430045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595ec4a-bb0b-43fc-a699-ce2f40c2481e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:23.474821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:23.554262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:23.555301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:23.556278 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:23.556775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] PATH_INFO: `/v3/projects/b7e5090dadb144579bc96fa9fca6b33f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:23.558621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e5090dadb144579bc96fa9fca6b33f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:23.561788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:23.701307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e5090dadb144579bc96fa9fca6b33f', 'request_id': 'req-ef675f11-5937-4f93-b443-717c083ef27e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:23.709148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e5090dadb144579bc96fa9fca6b33f', 'request_id': 'req-ef675f11-5937-4f93-b443-717c083ef27e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:23.800707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e5090dadb144579bc96fa9fca6b33f', 'request_id': 'req-ef675f11-5937-4f93-b443-717c083ef27e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:23.822325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] The token cache is being invalidate because project b7e5090dadb144579bc96fa9fca6b33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:23.822888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:23.823939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ef675f11-5937-4f93-b443-717c083ef27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:23.826719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1236/2442] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:23 2022] DELETE /identity/v3/projects/b7e5090dadb144579bc96fa9fca6b33f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:23.833202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ef2d-51e2-43bc-b18f-4ed769d9a70f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:23.833766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ef2d-51e2-43bc-b18f-4ed769d9a70f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:23.834534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ef2d-51e2-43bc-b18f-4ed769d9a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:23.869468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-6436ef2d-51e2-43bc-b18f-4ed769d9a70f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:23.869468 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6436ef2d-51e2-43bc-b18f-4ed769d9a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:23.883630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:23.963225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1207/2443] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:23.967811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834694a8-a7c8-430f-b8eb-1766ae44fd19 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:23.968450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834694a8-a7c8-430f-b8eb-1766ae44fd19 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:23.969045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834694a8-a7c8-430f-b8eb-1766ae44fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.000880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-834694a8-a7c8-430f-b8eb-1766ae44fd19 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:24.002961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-834694a8-a7c8-430f-b8eb-1766ae44fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:24.012254 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1237/2444] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:24.018178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436ef2d-51e2-43bc-b18f-4ed769d9a70f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:24.029244 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436ef2d-51e2-43bc-b18f-4ed769d9a70f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:24.034837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:24.035719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:24.035952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:24.036201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.038755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:24.038755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:24.039470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:24.057705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1208/2445] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:28:24.059275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834694a8-a7c8-430f-b8eb-1766ae44fd19 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:24.074200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834694a8-a7c8-430f-b8eb-1766ae44fd19 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:24.082518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:24.083270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:24.083554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:24.087544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.087544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:24.087544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:24.214199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1238/2446] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:24 2022] POST /identity/v3/projects => generated 397 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:24.218572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:24.239009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e950-d944-4258-a00e-8c97aede2ac6 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:24.329125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:24.329125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:24.329125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:24.329125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.330100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:24.336770 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:24.472131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1209/2447] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:24 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:24.476152 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:24.490304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232fdaa-272c-4595-9deb-9a18a28c826f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:24.496060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:24.496708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:24.496999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:24.497276 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.499215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:24.500037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:24.513174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1239/2448] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:24.518384 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:24.529564 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7374d-9ed5-41bf-9e3c-e76ea714282a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:24.535007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb76804-a80c-4bc1-ab6f-0481129def54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:24.535677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76804-a80c-4bc1-ab6f-0481129def54 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:24.536970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76804-a80c-4bc1-ab6f-0481129def54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:24.537269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76804-a80c-4bc1-ab6f-0481129def54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.538524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb76804-a80c-4bc1-ab6f-0481129def54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:24.540088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb76804-a80c-4bc1-ab6f-0481129def54 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:24.557242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1210/2449] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:24.561729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:24.576198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f024-c009-47fa-96c2-06f647a4ebd9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:24.582055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:24.583167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:24.583657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:24.584095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] PATH_INFO: `/v3/projects/a5e7be2414c649ba84294316ee49c873/users/037fa9c4a4e247d0812937badbcbb825/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.605356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e7be2414c649ba84294316ee49c873, user_id=037fa9c4a4e247d0812937badbcbb825, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:24.608658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:24.927896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1240/2450] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:24 2022] PUT /identity/v3/projects/a5e7be2414c649ba84294316ee49c873/users/037fa9c4a4e247d0812937badbcbb825/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:24.940226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538908c5-86b9-4682-9484-b381eafbe9d1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:24.940810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538908c5-86b9-4682-9484-b381eafbe9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:24.940810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538908c5-86b9-4682-9484-b381eafbe9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:24.971104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-538908c5-86b9-4682-9484-b381eafbe9d1 None None] MFA Rules not processed for user `037fa9c4a4e247d0812937badbcbb825`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:24.972072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-538908c5-86b9-4682-9484-b381eafbe9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:25.041515 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1211/2451] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:25.046264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:25.102616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:25.116110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ec753-5add-4c12-b146-4ad2558ebafb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:25.121022 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:25.121643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:25.121919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:25.122193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:25.123131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:25.125080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:25.212532 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1241/2452] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:25 2022] POST /identity/v3/projects => generated 399 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:25.217254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538908c5-86b9-4682-9484-b381eafbe9d1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:25.235931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538908c5-86b9-4682-9484-b381eafbe9d1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:25.251827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:25.325718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:25.326789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:25.327288 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:25.327785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:25.328970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:25.333492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:25.417898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1212/2453] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:25 2022] POST /identity/v3/users => generated 306 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:25.422594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:25.434132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3667fa-5fc5-4220-8f28-b8f8b3762324 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:25.440753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:25.441494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:25.441856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:25.442201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:25.442980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:25.444966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:25.463818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:25.469645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1242/2454] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:25.478293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0636e-c14b-416c-b3a2-8e4306220734 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:25.484094 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:25.484976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:25.485412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:25.485811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] PATH_INFO: `/v3/projects/b5eba95921254cfc8462048513690489/users/509e567fa7714b6abf4960f2c62d1f58/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:25.505906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5eba95921254cfc8462048513690489, user_id=509e567fa7714b6abf4960f2c62d1f58, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:25.509086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:25.625013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1213/2455] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:25 2022] PUT /identity/v3/projects/b5eba95921254cfc8462048513690489/users/509e567fa7714b6abf4960f2c62d1f58/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:25.630036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:25.641587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721621-ae22-4b92-af78-b2161556a9a9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:25.720495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f997e-9b77-482c-be82-6cdf9526a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:25.721708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f997e-9b77-482c-be82-6cdf9526a8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:25.721987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f997e-9b77-482c-be82-6cdf9526a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:25.722263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f997e-9b77-482c-be82-6cdf9526a8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:25.722962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f997e-9b77-482c-be82-6cdf9526a8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:25.724588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f997e-9b77-482c-be82-6cdf9526a8e7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:25.737439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1243/2456] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:25.742411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:25.754797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88715e-de88-42de-ab73-e68612879e5b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:25.759831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:25.760520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:25.760808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:25.761080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] PATH_INFO: `/v3/projects/b5eba95921254cfc8462048513690489/users/509e567fa7714b6abf4960f2c62d1f58/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:25.763694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5eba95921254cfc8462048513690489, user_id=509e567fa7714b6abf4960f2c62d1f58, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:25.766489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:25.779245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1214/2457] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:25 2022] PUT /identity/v3/projects/b5eba95921254cfc8462048513690489/users/509e567fa7714b6abf4960f2c62d1f58/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:25.795133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064b9e-f462-4b97-8fa6-1598b0b93721 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:25.795608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064b9e-f462-4b97-8fa6-1598b0b93721 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:25.796054 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064b9e-f462-4b97-8fa6-1598b0b93721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:25.840545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-36064b9e-f462-4b97-8fa6-1598b0b93721 None None] MFA Rules not processed for user `509e567fa7714b6abf4960f2c62d1f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:25.841794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-36064b9e-f462-4b97-8fa6-1598b0b93721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:25.940358 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1244/2458] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:25.956649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:25.960493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:26.043804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e69b2-2f32-4798-9ef9-27a4717c9cc7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:26.049487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:26.050502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:26.051030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:26.051539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:26.069217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:26.072150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:26.091762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1215/2459] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:26.326412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36064b9e-f462-4b97-8fa6-1598b0b93721 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:26.337593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36064b9e-f462-4b97-8fa6-1598b0b93721 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:26.343175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c4668-e7da-42e0-bfed-5ef4a165ac5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:26.344267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4668-e7da-42e0-bfed-5ef4a165ac5c service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:26.344755 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4668-e7da-42e0-bfed-5ef4a165ac5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:26.345274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4668-e7da-42e0-bfed-5ef4a165ac5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:26.431798 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:26.450443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c4668-e7da-42e0-bfed-5ef4a165ac5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:26.451938 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c4668-e7da-42e0-bfed-5ef4a165ac5c service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:26.463438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1245/2460] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:28:31.976774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:32.050600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823469f-3240-454e-9186-acf73e43513d service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:32.057274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:32.058123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:32.058399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:32.058871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] PATH_INFO: `/v3/users/037fa9c4a4e247d0812937badbcbb825` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:32.060190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=037fa9c4a4e247d0812937badbcbb825)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:32.062423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:32.077147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:32.318724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037fa9c4a4e247d0812937badbcbb825'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:32.342896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037fa9c4a4e247d0812937badbcbb825'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:32.343967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037fa9c4a4e247d0812937badbcbb825'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:32.411911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037fa9c4a4e247d0812937badbcbb825'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:32.412798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037fa9c4a4e247d0812937badbcbb825'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:32.427914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1216/2461] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:31 2022] DELETE /identity/v3/users/037fa9c4a4e247d0812937badbcbb825 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:32.432635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:32.433230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:32.433534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:32.465134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:32.467307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:32.547842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1246/2462] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:32.558053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:32.563628 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:32.640260 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c6c7-a097-4fe2-8d90-9f47af226829 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:32.644806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:32.645419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:32.645700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:32.645977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:32.658471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:32.663186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:32.675445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1217/2463] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:33.111664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:33.114732 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:33.132654 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcf92-86da-4bf0-a67c-c441962b0a9b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:33.140541 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:33.141586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:33.142005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:33.142551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] PATH_INFO: `/v3/projects/a5e7be2414c649ba84294316ee49c873` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:33.147231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e7be2414c649ba84294316ee49c873)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:33.149242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:33.294469 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e7be2414c649ba84294316ee49c873', 'request_id': 'req-5e1ced92-c422-4512-bcb9-c490b8f56b9a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.301927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e7be2414c649ba84294316ee49c873', 'request_id': 'req-5e1ced92-c422-4512-bcb9-c490b8f56b9a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.411354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e7be2414c649ba84294316ee49c873', 'request_id': 'req-5e1ced92-c422-4512-bcb9-c490b8f56b9a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.432483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] The token cache is being invalidate because project a5e7be2414c649ba84294316ee49c873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:33.434100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.434100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.434999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1247/2464] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:33 2022] DELETE /identity/v3/projects/a5e7be2414c649ba84294316ee49c873 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:33.439459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:33.449957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04bdcf-e2ee-458d-9280-8ebd14fc25bc service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:33.511937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:33.512581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:33.512865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:33.513142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] PATH_INFO: `/v3/users/509e567fa7714b6abf4960f2c62d1f58` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:33.514364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509e567fa7714b6abf4960f2c62d1f58)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:33.516395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:33.660695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:33.679368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509e567fa7714b6abf4960f2c62d1f58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.695900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509e567fa7714b6abf4960f2c62d1f58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.696817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509e567fa7714b6abf4960f2c62d1f58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.800516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509e567fa7714b6abf4960f2c62d1f58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.801135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-431689ad-9c61-4a4f-9151-93488368d6b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509e567fa7714b6abf4960f2c62d1f58'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:33.817837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1218/2465] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:33 2022] DELETE /identity/v3/users/509e567fa7714b6abf4960f2c62d1f58 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:34.398516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:34.400419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:34.416181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ced92-c422-4512-bcb9-c490b8f56b9a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:34.507921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:34.508592 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:34.511061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:34.511370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] PATH_INFO: `/v3/projects/b5eba95921254cfc8462048513690489` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:34.519601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5eba95921254cfc8462048513690489)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:34.522096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:34.535320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:34.667011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5eba95921254cfc8462048513690489', 'request_id': 'req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:34.676754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5eba95921254cfc8462048513690489', 'request_id': 'req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:34.749926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5eba95921254cfc8462048513690489', 'request_id': 'req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:34.765651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] The token cache is being invalidate because project b5eba95921254cfc8462048513690489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:34.765921 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:34.766775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fa79d5a-56cb-40c0-a831-8b3e94f6c3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:34.768672 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1248/2466] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:34 2022] DELETE /identity/v3/projects/b5eba95921254cfc8462048513690489 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:34.775092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434e006-0855-49f5-b91d-a819643a40e6 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:34.775834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434e006-0855-49f5-b91d-a819643a40e6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:34.776758 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434e006-0855-49f5-b91d-a819643a40e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:34.802143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1434e006-0855-49f5-b91d-a819643a40e6 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:34.803418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1434e006-0855-49f5-b91d-a819643a40e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:34.869695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1219/2467] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:34.877984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa792f97-2beb-4dae-be97-6dd36e3f436b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:34.878289 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa792f97-2beb-4dae-be97-6dd36e3f436b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:34.878619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa792f97-2beb-4dae-be97-6dd36e3f436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:34.899348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fa792f97-2beb-4dae-be97-6dd36e3f436b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:34.900597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fa792f97-2beb-4dae-be97-6dd36e3f436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:34.909147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1249/2468] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:34.913674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434e006-0855-49f5-b91d-a819643a40e6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:34.924671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434e006-0855-49f5-b91d-a819643a40e6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:34.929716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:34.930349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:34.930677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:34.930955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:34.931660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:34.931965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:34.933666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:34.948064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1220/2469] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:28:34.953151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa792f97-2beb-4dae-be97-6dd36e3f436b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:34.963261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa792f97-2beb-4dae-be97-6dd36e3f436b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:34.968155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:34.968708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:34.968995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:34.969280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:34.969919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:34.972402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:35.062825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1250/2470] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:34 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:35.064103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:35.074508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435a71-9c68-47f0-84a9-dcda62c6eebf admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:35.139943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:35.140567 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:35.140854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:35.141136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:35.141789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:35.144759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:35.242386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1221/2471] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:35 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:35.246886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:35.258507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c2f88-fc69-4de3-ba7b-a6a54258df18 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:35.263378 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:35.264565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:35.264565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:35.264565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:35.265197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:35.267339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:35.279223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1251/2472] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:35.284707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:35.304992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fbafa-4479-4e9b-9ba7-bf5ac88da682 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:35.314503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefea11-52f3-48eb-b70e-eb1ea405df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:35.315640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefea11-52f3-48eb-b70e-eb1ea405df5b admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:35.316406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefea11-52f3-48eb-b70e-eb1ea405df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:35.316644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefea11-52f3-48eb-b70e-eb1ea405df5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:35.318336 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefea11-52f3-48eb-b70e-eb1ea405df5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:35.321379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefea11-52f3-48eb-b70e-eb1ea405df5b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:35.335587 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1222/2473] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:35.340608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:35.352910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257852b-6e7f-4542-87a1-19f5938e2a9f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:35.357682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:35.358357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:35.358744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:35.359026 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] PATH_INFO: `/v3/projects/c685356a6fc549bebc6b663a55d824ee/users/281b4914021c417787ffc1f2ba132c2b/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:35.376215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c685356a6fc549bebc6b663a55d824ee, user_id=281b4914021c417787ffc1f2ba132c2b, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:35.379106 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:35.487413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1252/2474] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:35 2022] PUT /identity/v3/projects/c685356a6fc549bebc6b663a55d824ee/users/281b4914021c417787ffc1f2ba132c2b/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:35.499817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245cb87-d0c2-4165-9ab1-d0e0302c8770 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:35.500052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245cb87-d0c2-4165-9ab1-d0e0302c8770 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:35.500299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245cb87-d0c2-4165-9ab1-d0e0302c8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:35.531565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1245cb87-d0c2-4165-9ab1-d0e0302c8770 None None] MFA Rules not processed for user `281b4914021c417787ffc1f2ba132c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:35.532836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1245cb87-d0c2-4165-9ab1-d0e0302c8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:35.537427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:35.622765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1223/2475] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:35.631236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:35.633025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:35.702202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c3eee-a87a-45a0-9d1d-3e224287f52a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:35.706972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7934-d268-4ea5-9b11-34cc65a4f738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:35.707596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7934-d268-4ea5-9b11-34cc65a4f738 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:35.707881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7934-d268-4ea5-9b11-34cc65a4f738 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:35.708143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7934-d268-4ea5-9b11-34cc65a4f738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:35.717387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7934-d268-4ea5-9b11-34cc65a4f738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:35.718720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7934-d268-4ea5-9b11-34cc65a4f738 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:35.727957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1253/2476] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:35.749754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245cb87-d0c2-4165-9ab1-d0e0302c8770 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:35.837241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245cb87-d0c2-4165-9ab1-d0e0302c8770 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:35.842664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:35.843265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:35.843600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:35.843945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] PATH_INFO: `/v3/users/281b4914021c417787ffc1f2ba132c2b` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:35.845351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281b4914021c417787ffc1f2ba132c2b)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:35.847746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:36.125595 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281b4914021c417787ffc1f2ba132c2b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:36.143309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281b4914021c417787ffc1f2ba132c2b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:36.144067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281b4914021c417787ffc1f2ba132c2b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:36.236263 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281b4914021c417787ffc1f2ba132c2b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:36.238756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281b4914021c417787ffc1f2ba132c2b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:36.255100 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1224/2477] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:35 2022] DELETE /identity/v3/users/281b4914021c417787ffc1f2ba132c2b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:28:36.259792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:36.260112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:36.260399 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:36.284461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:36.291210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:36.326316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:36.368550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1254/2478] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:36.379796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:36.381241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:36.414370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:36.447966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d54c4-cfbb-4153-9d91-0eda381e1586 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:36.451810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:36.452432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:36.452713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:36.452982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:36.463380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:36.464819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:36.476234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1225/2479] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:37.038421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:37.081102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:37.081102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c631d-da3b-4655-bc18-9e5ebdf66acd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:37.087163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:37.087823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.088336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.088562 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] PATH_INFO: `/v3/projects/c685356a6fc549bebc6b663a55d824ee` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.089826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c685356a6fc549bebc6b663a55d824ee)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:37.091852 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:37.258121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c685356a6fc549bebc6b663a55d824ee', 'request_id': 'req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:37.265569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c685356a6fc549bebc6b663a55d824ee', 'request_id': 'req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:37.355227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:37.365104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9a1c3-1c40-4438-85cf-65384ba78380 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:37.365928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c685356a6fc549bebc6b663a55d824ee', 'request_id': 'req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:37.379765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] The token cache is being invalidate because project c685356a6fc549bebc6b663a55d824ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:37.380065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:37.380740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-cf5b7fbe-50af-487f-9e3e-71dcd5aa4fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:37.382241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1255/2480] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:37 2022] DELETE /identity/v3/projects/c685356a6fc549bebc6b663a55d824ee => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:37.387513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490a59-90ce-4235-a437-641e8b7dd840 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.387876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490a59-90ce-4235-a437-641e8b7dd840 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.388269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490a59-90ce-4235-a437-641e8b7dd840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.409463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-02490a59-90ce-4235-a437-641e8b7dd840 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:37.410848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-02490a59-90ce-4235-a437-641e8b7dd840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:37.422324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:37.423538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.423538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.423538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.423538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:37.488782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1256/2481] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:37.498203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176706d6-5d15-4637-8d3e-e672d406d983 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.498492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176706d6-5d15-4637-8d3e-e672d406d983 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.498806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176706d6-5d15-4637-8d3e-e672d406d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.506522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:37.511253 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:37.521861 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-176706d6-5d15-4637-8d3e-e672d406d983 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:37.523175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-176706d6-5d15-4637-8d3e-e672d406d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:37.531510 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1257/2483] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:37.536435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176706d6-5d15-4637-8d3e-e672d406d983 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:37.538706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1226/2483] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:28:37.553736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176706d6-5d15-4637-8d3e-e672d406d983 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:37.571089 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:37.571731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.572016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.572661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.572978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:37.573293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:37.575043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:37.593618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1258/2484] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:28:37.605165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:37.616165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b12288-73a4-4d8a-b69c-dbca8ca375cd service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:37.622839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:37.623475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.623760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.624108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.624799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:37.628958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:37.723385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1227/2485] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:37 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:37.728095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:37.739164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decd05d-ffb1-406c-ae41-9e5f4726c085 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:37.788406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:37.807961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:37.808579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.809167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.809446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.810093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:37.812128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:37.946480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1259/2486] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:37 2022] POST /identity/v3/users => generated 282 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:37.952775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:37.979427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c347-a8e7-418b-8a25-fa64000abd7c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:37.987635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:37.988676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:37.989168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:37.989805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:37.990886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:37.994017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:38.013308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1228/2487] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:38.018048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:38.033522 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f98e5-ef75-4095-8592-08d5eb87abd8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:38.046183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9136bc-9f52-4d68-8257-9b00dc258e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:38.047387 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9136bc-9f52-4d68-8257-9b00dc258e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.048619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9136bc-9f52-4d68-8257-9b00dc258e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.049970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9136bc-9f52-4d68-8257-9b00dc258e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.051697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9136bc-9f52-4d68-8257-9b00dc258e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:38.054438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9136bc-9f52-4d68-8257-9b00dc258e85 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:38.068658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1260/2488] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:38.075605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:38.089613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba3e70-349d-4919-9f4b-d98e0ce8f7aa admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:38.096550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6679e-b405-450a-94ab-efa507e7ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:38.097233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6679e-b405-450a-94ab-efa507e7ec9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.097517 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6679e-b405-450a-94ab-efa507e7ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.097802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6679e-b405-450a-94ab-efa507e7ec9a admin admin] PATH_INFO: `/v3/projects/47e62c56450a4de3a7e1b45eab5e8b15/users/60ffb83622eb481bbaf26973982afb9d/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.116278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6679e-b405-450a-94ab-efa507e7ec9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e62c56450a4de3a7e1b45eab5e8b15, user_id=60ffb83622eb481bbaf26973982afb9d, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:38.119158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6679e-b405-450a-94ab-efa507e7ec9a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:38.232493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1229/2489] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:38 2022] PUT /identity/v3/projects/47e62c56450a4de3a7e1b45eab5e8b15/users/60ffb83622eb481bbaf26973982afb9d/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:38.245936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.246133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.246512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.254584 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.255108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.255680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.316177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:38.318269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:38.322987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] MFA Rules not processed for user `60ffb83622eb481bbaf26973982afb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:38.326524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:38.329087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:38.421465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1230/2490] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:38.477697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1261/2491] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:38.490916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:38.493298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:38.566019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:38.568257 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcf11b-712e-4f77-8a1d-5cbca84cdaa6 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:38.568461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:38.577129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:38.577129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.577129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.577129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.584023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:38.585255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:38.624269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1231/2492] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:38.684411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a25787-19ae-48b9-9b6e-d35bf0bb0b68 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:38.691211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:38.691848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.692134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.692421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.701825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:38.703490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:38.715819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1262/2493] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:28:43.573825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:43.576074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:43.750213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710594df-264a-4b17-b696-e8305ded2d1f service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:43.757950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:43.760917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:43.761344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:43.762652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] PATH_INFO: `/v3/users/acd37d5161b247139f337ef0bf50a764` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:43.766090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd37d5161b247139f337ef0bf50a764)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:43.769682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:44.043179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd37d5161b247139f337ef0bf50a764'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:44.062705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:44.067802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd37d5161b247139f337ef0bf50a764'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:44.068798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd37d5161b247139f337ef0bf50a764'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:44.160532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd37d5161b247139f337ef0bf50a764'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:44.161282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-3d29ebbb-21a3-42cc-aaa5-a8521aa070df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd37d5161b247139f337ef0bf50a764'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:44.178759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1232/2494] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:43 2022] DELETE /identity/v3/users/acd37d5161b247139f337ef0bf50a764 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:44.746728 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:44.765527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33493ba-d4f0-4a80-ab81-c73d351f3444 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:44.828262 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:44.855686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:44.856345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:44.856626 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:44.856900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] PATH_INFO: `/v3/projects/f95e63e2fad24821953b5549e26f9dbd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:44.858098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95e63e2fad24821953b5549e26f9dbd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:44.860097 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:45.187045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95e63e2fad24821953b5549e26f9dbd', 'request_id': 'req-56913da1-9091-4e54-824f-8666ee200f8f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:45.193342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95e63e2fad24821953b5549e26f9dbd', 'request_id': 'req-56913da1-9091-4e54-824f-8666ee200f8f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:45.395130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95e63e2fad24821953b5549e26f9dbd', 'request_id': 'req-56913da1-9091-4e54-824f-8666ee200f8f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:45.418964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] The token cache is being invalidate because project f95e63e2fad24821953b5549e26f9dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:45.419390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:45.420783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-56913da1-9091-4e54-824f-8666ee200f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:45.424043 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1263/2495] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:44 2022] DELETE /identity/v3/projects/f95e63e2fad24821953b5549e26f9dbd => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:45.430278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7429-b427-4c05-8685-0ff5b3205397 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:45.430278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7429-b427-4c05-8685-0ff5b3205397 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:45.431018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7429-b427-4c05-8685-0ff5b3205397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:45.466271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-735c7429-b427-4c05-8685-0ff5b3205397 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:45.467617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-735c7429-b427-4c05-8685-0ff5b3205397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:45.557300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1233/2496] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:45.558787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae4e07-2316-4651-8e3f-8b491c7df20e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:45.559191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae4e07-2316-4651-8e3f-8b491c7df20e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:45.559551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae4e07-2316-4651-8e3f-8b491c7df20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:45.592201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-57ae4e07-2316-4651-8e3f-8b491c7df20e None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:45.593570 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-57ae4e07-2316-4651-8e3f-8b491c7df20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:45.605883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1264/2497] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:45.612680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c7429-b427-4c05-8685-0ff5b3205397 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:45.627971 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c7429-b427-4c05-8685-0ff5b3205397 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:45.637410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:45.639470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:45.639470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:45.639470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:45.639893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:45.639893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:45.641411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:45.665071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1234/2498] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:28:45.672599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae4e07-2316-4651-8e3f-8b491c7df20e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:45.691793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae4e07-2316-4651-8e3f-8b491c7df20e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:45.696967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:45.697673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:45.698056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:45.698406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:45.699190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:45.702038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:45.858506 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1265/2499] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:45 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:45.860038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:45.872028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ddb3-c4ca-44cf-879f-14d75531834e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:45.946926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:45.947715 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:45.948101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:45.948475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:45.949082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:45.951058 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:46.244151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1235/2500] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:45 2022] POST /identity/v3/users => generated 293 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:46.245411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:46.258070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937a6e-da90-4411-9d48-c0e84a781d5a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:46.262579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:46.265166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:46.265166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:46.265166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:46.265166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:46.266200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:46.280023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1266/2501] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:46.284696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:46.295057 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115558-806a-4334-9f5a-2a84eda7bba6 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:46.301870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b254-2dca-4367-a488-54b4a2b8859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:46.302485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b254-2dca-4367-a488-54b4a2b8859f admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:46.302821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b254-2dca-4367-a488-54b4a2b8859f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:46.303096 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b254-2dca-4367-a488-54b4a2b8859f admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:46.303742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b254-2dca-4367-a488-54b4a2b8859f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:46.305341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b254-2dca-4367-a488-54b4a2b8859f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:46.319722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1236/2502] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:46.324293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:46.335264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddb5c4-2984-478d-bf87-83c924097828 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:46.341545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:46.342705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:46.342705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:46.343030 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] PATH_INFO: `/v3/projects/ce3c6f9ea3764773a663c1a67b1c5ae6/users/d3375fbaa62241cf83dd214b21d742b8/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:46.361580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3c6f9ea3764773a663c1a67b1c5ae6, user_id=d3375fbaa62241cf83dd214b21d742b8, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:46.368720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:46.511645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1267/2503] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:46 2022] PUT /identity/v3/projects/ce3c6f9ea3764773a663c1a67b1c5ae6/users/d3375fbaa62241cf83dd214b21d742b8/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:46.520522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918649b-6a32-4732-8cd8-ccc139f079a0 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:46.522250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918649b-6a32-4732-8cd8-ccc139f079a0 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:46.522600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918649b-6a32-4732-8cd8-ccc139f079a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:46.565726 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d918649b-6a32-4732-8cd8-ccc139f079a0 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:46.567195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d918649b-6a32-4732-8cd8-ccc139f079a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:46.643145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:46.664920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1237/2504] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:46.676648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:46.679827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:46.765306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d48a-cc03-4e0c-9baf-d142df4c784b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:46.769356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:46.770368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:46.770673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:46.771034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:46.783241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:46.784914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:46.797267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1268/2505] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:53.838808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734ee2-c938-43d0-a4fb-94b3621d804b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:53.839393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734ee2-c938-43d0-a4fb-94b3621d804b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:53.839565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734ee2-c938-43d0-a4fb-94b3621d804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:53.872722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7e734ee2-c938-43d0-a4fb-94b3621d804b None None] MFA Rules not processed for user `d3375fbaa62241cf83dd214b21d742b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:53.874231 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7e734ee2-c938-43d0-a4fb-94b3621d804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:53.970603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1238/2506] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:53.987484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:53.989663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:54.004752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:54.075183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361c9d-97f6-4ece-ab0e-fc87c906ff4c service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:54.081243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:54.081859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:54.082146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:54.082426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:54.091594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:54.093247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:54.104555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1269/2507] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:57.103927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211bcc-2391-42eb-9139-995954f5a60f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:57.107848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211bcc-2391-42eb-9139-995954f5a60f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:57.107848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211bcc-2391-42eb-9139-995954f5a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:57.127600 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-33211bcc-2391-42eb-9139-995954f5a60f None None] MFA Rules not processed for user `d3375fbaa62241cf83dd214b21d742b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:57.128935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-33211bcc-2391-42eb-9139-995954f5a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:57.136718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1239/2508] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:57.496024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:57.505853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc63a6-29a8-48b8-b2e0-a536bc698ccb service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:57.509568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:57.510178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:57.510457 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:57.510766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:57.512465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:57.522342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:57.523791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:57.531589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1270/2509] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:04.343970 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c96d7-606b-442b-9c70-6048ce28a222 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:04.345149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c96d7-606b-442b-9c70-6048ce28a222 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:04.345149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c96d7-606b-442b-9c70-6048ce28a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:04.365074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7b2c96d7-606b-442b-9c70-6048ce28a222 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:04.366450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7b2c96d7-606b-442b-9c70-6048ce28a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:04.427351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1240/2510] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:29:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:04.441730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:04.443279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:04.534042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07167e-7799-4c81-b2a5-ddc86e87a239 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:04.545451 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:04.546085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:04.546365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:04.546663 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:04.556452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:04.558160 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:04.568077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1271/2511] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:29:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:29:14.420451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=67 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:14.563616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=68 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:21.483440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714942-a3ff-44fa-8938-42b7eaeeec1f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:21.485447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714942-a3ff-44fa-8938-42b7eaeeec1f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:21.485447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714942-a3ff-44fa-8938-42b7eaeeec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:21.505730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4d714942-a3ff-44fa-8938-42b7eaeeec1f None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:21.507026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4d714942-a3ff-44fa-8938-42b7eaeeec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:21.527520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1241/2512] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 17 20:29:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:21.540460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:21.554113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba33a75-4bbf-4e0a-a538-12c5464cedb6 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:21.557681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:21.558345 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:21.558886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:21.559167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:21.568733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:21.570309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:21.578576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1272/2513] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 20:29:22.540023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d714942-a3ff-44fa-8938-42b7eaeeec1f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:22.553125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d714942-a3ff-44fa-8938-42b7eaeeec1f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:22.556925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d4e28-4c92-49c6-b4fe-8b367e106599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:22.557604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4e28-4c92-49c6-b4fe-8b367e106599 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:22.557892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4e28-4c92-49c6-b4fe-8b367e106599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:22.558171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4e28-4c92-49c6-b4fe-8b367e106599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:22.560362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-777d4e28-4c92-49c6-b4fe-8b367e106599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:22.631916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d4e28-4c92-49c6-b4fe-8b367e106599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:22.633457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d4e28-4c92-49c6-b4fe-8b367e106599 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:22.644228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1242/2514] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:24.130440 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:24.131989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:24.152060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450bbee-ad0d-46f4-8639-0327af1fe6ee service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:24.173954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:24.174817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:24.175305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:24.175761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] PATH_INFO: `/v3/users/60ffb83622eb481bbaf26973982afb9d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:24.178780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ffb83622eb481bbaf26973982afb9d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:24.183956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:24.392021 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ffb83622eb481bbaf26973982afb9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:24.409981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ffb83622eb481bbaf26973982afb9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:24.432750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ffb83622eb481bbaf26973982afb9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:24.433176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ffb83622eb481bbaf26973982afb9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:24.554894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ffb83622eb481bbaf26973982afb9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:24.562070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1273/2515] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:24 2022] DELETE /identity/v3/users/60ffb83622eb481bbaf26973982afb9d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:24.567596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:24.568106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:24.568219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:24.590026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:24.591659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:24.677230 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1243/2516] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:24.688895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:24.688895 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:24.767586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8267f2-dc22-4d23-b8b7-d96fb0640a33 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:24.773838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da26acb-d46a-4aff-a5f9-08e37f8b3cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:24.774990 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26acb-d46a-4aff-a5f9-08e37f8b3cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:24.775482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26acb-d46a-4aff-a5f9-08e37f8b3cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:24.776007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26acb-d46a-4aff-a5f9-08e37f8b3cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:24.792912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da26acb-d46a-4aff-a5f9-08e37f8b3cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:24.795710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da26acb-d46a-4aff-a5f9-08e37f8b3cc3 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:24.809699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1274/2517] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:25.316178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:25.317626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:25.330438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29eb48-a82f-4b8f-aed2-c6d3f561a886 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:25.335368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:25.336030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:25.336312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:25.336592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] PATH_INFO: `/v3/projects/47e62c56450a4de3a7e1b45eab5e8b15` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:25.337851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e62c56450a4de3a7e1b45eab5e8b15)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:25.339816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:25.496269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e62c56450a4de3a7e1b45eab5e8b15', 'request_id': 'req-0f0f9649-7c58-4f69-a48e-33f4d3200be2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:25.502465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e62c56450a4de3a7e1b45eab5e8b15', 'request_id': 'req-0f0f9649-7c58-4f69-a48e-33f4d3200be2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:25.605514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e62c56450a4de3a7e1b45eab5e8b15', 'request_id': 'req-0f0f9649-7c58-4f69-a48e-33f4d3200be2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:25.621989 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] The token cache is being invalidate because project 47e62c56450a4de3a7e1b45eab5e8b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:25.622292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:25.623015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f0f9649-7c58-4f69-a48e-33f4d3200be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:25.624672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1244/2518] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:25 2022] DELETE /identity/v3/projects/47e62c56450a4de3a7e1b45eab5e8b15 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:25.630705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ce2b-2aa6-4422-83a1-2635325f670b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:25.631234 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ce2b-2aa6-4422-83a1-2635325f670b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:25.631334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ce2b-2aa6-4422-83a1-2635325f670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:25.653740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1868ce2b-2aa6-4422-83a1-2635325f670b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:25.655123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1868ce2b-2aa6-4422-83a1-2635325f670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:25.741281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1275/2519] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:29:25.750352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710724f8-434d-4c9f-8ac9-3e713a8032a1 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:25.751003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710724f8-434d-4c9f-8ac9-3e713a8032a1 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:25.751490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710724f8-434d-4c9f-8ac9-3e713a8032a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:25.779929 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-710724f8-434d-4c9f-8ac9-3e713a8032a1 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:25.781710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-710724f8-434d-4c9f-8ac9-3e713a8032a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:25.789757 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1245/2520] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:25.794683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868ce2b-2aa6-4422-83a1-2635325f670b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:25.800941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:25.806690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868ce2b-2aa6-4422-83a1-2635325f670b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:25.811580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:25.812210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:25.812638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:25.813102 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:25.813778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:29:25.814085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:25.815736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:25.830161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1276/2521] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:29:25.842181 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710724f8-434d-4c9f-8ac9-3e713a8032a1 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:25.847582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:25.854082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710724f8-434d-4c9f-8ac9-3e713a8032a1 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:25.860081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:25.860719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:25.860998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:25.861340 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:25.861993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:25.863980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:25.997589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1246/2522] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:25 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:26.002115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:26.012939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ffa9-668c-4a8d-bdbb-afa9fcb934ee admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:26.088983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:26.089689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:26.097093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:26.097093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:26.097093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:26.097093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:26.212166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1277/2523] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:26 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:26.216525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:26.227276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cf390-55b7-4fd6-b3cd-51a2c925922e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:26.231841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:26.234073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:26.234073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:26.234073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:26.234073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:26.235804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:26.245949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1247/2524] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:26.251604 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:26.262795 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960c79-0571-4e09-b711-41873a8c2276 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:26.267804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149d50b-6f71-4cbd-9afc-3cc523903dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:26.270271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d50b-6f71-4cbd-9afc-3cc523903dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:26.270271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d50b-6f71-4cbd-9afc-3cc523903dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:26.270271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d50b-6f71-4cbd-9afc-3cc523903dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:26.270271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149d50b-6f71-4cbd-9afc-3cc523903dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:26.271261 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149d50b-6f71-4cbd-9afc-3cc523903dc7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:26.283096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1278/2525] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:26.287473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:26.300054 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2b06-41e4-4792-943f-596bc2b987e0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:26.304850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:26.305457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:26.305739 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:26.306010 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] PATH_INFO: `/v3/projects/f3f2c8327c2c4c2895e6f27bfc70b389/users/1fce64e821214b9d99347f6958d86e08/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:26.322118 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f2c8327c2c4c2895e6f27bfc70b389, user_id=1fce64e821214b9d99347f6958d86e08, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:26.324795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:26.461799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1248/2526] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:26 2022] PUT /identity/v3/projects/f3f2c8327c2c4c2895e6f27bfc70b389/users/1fce64e821214b9d99347f6958d86e08/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:26.473495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:26.473814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:26.474114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:26.506027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] MFA Rules not processed for user `1fce64e821214b9d99347f6958d86e08`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:26.507350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:26.595707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1279/2527] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:26.607537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:26.609950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:26.676534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d222d-9daa-475a-8fad-d282477e0440 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:26.680106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:26.680812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:26.681102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:26.681382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:26.696376 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:26.697766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:26.707896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1249/2528] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:30.477839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:30.481340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:30.545207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0261713-3e09-4bb8-8f74-9dba0cebd9bd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:30.549610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:30.550280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:30.550560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:30.550885 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:30.555175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:30.567087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:30.623622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:30.625912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:30.635872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1280/2529] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:36.732811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:39.037059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:39.049742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243184-6bd1-46b2-b14b-25952885d8ad service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:39.056145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:39.057085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:39.057650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:39.058225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] PATH_INFO: `/v3/users/1fce64e821214b9d99347f6958d86e08` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:39.060039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fce64e821214b9d99347f6958d86e08)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:39.064659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:39.223936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:39.226500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:39.241052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb1f93-916a-4c20-b740-16d859587530 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:39.246519 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:39.249944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:39.249944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:39.249944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] PATH_INFO: `/v3/users/cfa791db71dd4345ba4b5988a33ec533` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:39.249944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa791db71dd4345ba4b5988a33ec533)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:39.250784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:39.285604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fce64e821214b9d99347f6958d86e08'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.299167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fce64e821214b9d99347f6958d86e08'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.299892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fce64e821214b9d99347f6958d86e08'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.377082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fce64e821214b9d99347f6958d86e08'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.377871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f449b6c-8d7f-4f56-b54d-ea8bb8bd5f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fce64e821214b9d99347f6958d86e08'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.392891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1250/2530] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:39 2022] DELETE /identity/v3/users/1fce64e821214b9d99347f6958d86e08 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:39.397363 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:39.397678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:39.398036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:39.417945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:39.426690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:39.466897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa791db71dd4345ba4b5988a33ec533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.479994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa791db71dd4345ba4b5988a33ec533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.483434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1251/2531] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:29:39.491189 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa791db71dd4345ba4b5988a33ec533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.491592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:39.496581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa791db71dd4345ba4b5988a33ec533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.496752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:39.555158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef583-ce36-4193-b7bf-bee4d8fbb636 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:39.559006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:39.564333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:39.564333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:39.564333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:39.571663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:39.573144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:39.583782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1252/2532] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:29:39.588224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa791db71dd4345ba4b5988a33ec533'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:39.595641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1281/2533] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:39 2022] DELETE /identity/v3/users/cfa791db71dd4345ba4b5988a33ec533 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:40.024753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:40.026458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:40.041186 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195f32-43ea-4951-9e99-ebbc4eb2ba5d service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:40.065792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:40.067076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:40.068536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:40.134791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:40.135923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:40.136415 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:40.136906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] PATH_INFO: `/v3/projects/1291a3f047aa40278c9d3d048abc194e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:40.138938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1291a3f047aa40278c9d3d048abc194e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:40.144882 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:40.145053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450413e-ba58-4fe1-ae5e-eca9f29bfb48 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:40.149937 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:40.150612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:40.150928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:40.151281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] PATH_INFO: `/v3/projects/f3f2c8327c2c4c2895e6f27bfc70b389` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:40.152497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f2c8327c2c4c2895e6f27bfc70b389)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:40.154438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:40.187678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:40.329751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f2c8327c2c4c2895e6f27bfc70b389', 'request_id': 'req-8ca36a66-3e88-4505-998b-2f72879ed6fb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.331678 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1291a3f047aa40278c9d3d048abc194e', 'request_id': 'req-7da67a17-2b51-411b-ab5b-5ca409eeed6c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.337190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f2c8327c2c4c2895e6f27bfc70b389', 'request_id': 'req-8ca36a66-3e88-4505-998b-2f72879ed6fb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.340145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1291a3f047aa40278c9d3d048abc194e', 'request_id': 'req-7da67a17-2b51-411b-ab5b-5ca409eeed6c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.426426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f2c8327c2c4c2895e6f27bfc70b389', 'request_id': 'req-8ca36a66-3e88-4505-998b-2f72879ed6fb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.439703 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] The token cache is being invalidate because project f3f2c8327c2c4c2895e6f27bfc70b389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:40.440001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.440670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.442244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1282/2534] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:40 2022] DELETE /identity/v3/projects/f3f2c8327c2c4c2895e6f27bfc70b389 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:40.518318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1291a3f047aa40278c9d3d048abc194e', 'request_id': 'req-7da67a17-2b51-411b-ab5b-5ca409eeed6c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.532076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] The token cache is being invalidate because project 1291a3f047aa40278c9d3d048abc194e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:40.532365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.533056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.534843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1253/2535] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:40 2022] DELETE /identity/v3/projects/1291a3f047aa40278c9d3d048abc194e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:40.539053 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:40.540530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:40.616251 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca36a66-3e88-4505-998b-2f72879ed6fb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:40.688772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:40.689432 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:40.689717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:40.690064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] PATH_INFO: `/v3/users/40a9c3267aa1411fb904384610597e2f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:40.691382 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a9c3267aa1411fb904384610597e2f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:40.693477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:40.923824 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a9c3267aa1411fb904384610597e2f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.934932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:40.937294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a9c3267aa1411fb904384610597e2f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.944915 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a9c3267aa1411fb904384610597e2f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:40.946062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a9c3267aa1411fb904384610597e2f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:41.015491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ae521ed0-69b2-489c-8680-dd6b4d14acab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a9c3267aa1411fb904384610597e2f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:41.023423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1283/2536] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:40 2022] DELETE /identity/v3/users/40a9c3267aa1411fb904384610597e2f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:41.307735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:41.309243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:41.327811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67a17-2b51-411b-ab5b-5ca409eeed6c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:41.398922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:41.399656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:41.400153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:41.400438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] PATH_INFO: `/v3/projects/8bdd361c918c43288eca38f58c991df2` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:41.401639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bdd361c918c43288eca38f58c991df2)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:41.403742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:41.557202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:41.558975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdd361c918c43288eca38f58c991df2', 'request_id': 'req-1732848d-cdf7-4556-993a-125eebf7a6ba'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:41.565011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdd361c918c43288eca38f58c991df2', 'request_id': 'req-1732848d-cdf7-4556-993a-125eebf7a6ba'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:41.662488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdd361c918c43288eca38f58c991df2', 'request_id': 'req-1732848d-cdf7-4556-993a-125eebf7a6ba'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:41.676576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] The token cache is being invalidate because project 8bdd361c918c43288eca38f58c991df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:41.677121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:41.677791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-1732848d-cdf7-4556-993a-125eebf7a6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:41.679549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1254/2537] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:41 2022] DELETE /identity/v3/projects/8bdd361c918c43288eca38f58c991df2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:41.684484 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102a5e-5f14-4dae-859d-3cba5d163ce6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:41.684951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102a5e-5f14-4dae-859d-3cba5d163ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:41.685070 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102a5e-5f14-4dae-859d-3cba5d163ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:41.708892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-67102a5e-5f14-4dae-859d-3cba5d163ce6 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:41.712624 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-67102a5e-5f14-4dae-859d-3cba5d163ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:41.793865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1284/2538] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:41.804516 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd74f-d581-4df6-9f68-06f31922e18b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:41.804813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd74f-d581-4df6-9f68-06f31922e18b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:41.805088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd74f-d581-4df6-9f68-06f31922e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:41.830413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-777cd74f-d581-4df6-9f68-06f31922e18b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:41.831692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-777cd74f-d581-4df6-9f68-06f31922e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:41.840604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1255/2539] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:41.845634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102a5e-5f14-4dae-859d-3cba5d163ce6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:41.856379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102a5e-5f14-4dae-859d-3cba5d163ce6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:41.861956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:41.862587 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:41.862910 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:41.863190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:41.863858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:29:41.864167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:41.865943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:41.880179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1285/2540] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:29:41.884890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd74f-d581-4df6-9f68-06f31922e18b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:41.895746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd74f-d581-4df6-9f68-06f31922e18b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:41.900783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:41.901401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:41.901681 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:41.901956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:41.902592 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:41.904572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:41.996674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1256/2541] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:41 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:42.001477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:42.012335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad444357-2d18-4582-85fc-207de0130e1b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:42.074554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:42.075208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:42.075495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:42.075774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:42.076418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:42.078780 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:42.188348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1286/2542] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:42 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:42.192841 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:42.204113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e3aa-e019-4225-b5ae-c0f1f3db6c9c admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:42.209019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:42.209660 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:42.209946 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:42.210226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:42.210948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:42.212601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:42.224618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1257/2543] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:42.230436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:42.243211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c84660-ca93-43ff-ad81-2e185d7b74cd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:42.250478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6cfd-069a-41f0-bb84-dc62104577ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:42.251537 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6cfd-069a-41f0-bb84-dc62104577ec admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:42.251999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6cfd-069a-41f0-bb84-dc62104577ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:42.252351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6cfd-069a-41f0-bb84-dc62104577ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:42.253333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6cfd-069a-41f0-bb84-dc62104577ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:42.255056 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6cfd-069a-41f0-bb84-dc62104577ec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:42.267478 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1287/2544] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:42.271811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:42.283239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c77f92-45ce-4046-b8e3-356070342a35 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:42.288152 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:42.288842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:42.289141 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:42.289427 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] PATH_INFO: `/v3/projects/62ed5118006d48e8a68f1f4506e54546/users/79b37b77e3e44797b58ef9dd89747ca4/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:42.306182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ed5118006d48e8a68f1f4506e54546, user_id=79b37b77e3e44797b58ef9dd89747ca4, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:42.308927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:42.394765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1258/2545] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:42 2022] PUT /identity/v3/projects/62ed5118006d48e8a68f1f4506e54546/users/79b37b77e3e44797b58ef9dd89747ca4/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:42.400239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d989db-2b69-4238-b732-9d1358563940 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:42.405113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d989db-2b69-4238-b732-9d1358563940 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:42.405113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d989db-2b69-4238-b732-9d1358563940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:42.426791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-24d989db-2b69-4238-b732-9d1358563940 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:42.428917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-24d989db-2b69-4238-b732-9d1358563940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:42.473627 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:42.498240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1288/2546] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:42.508508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:42.510238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:42.570383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562bcf6-43e2-44e0-8289-841dcc7364dd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:42.574046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:42.574709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:42.575026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:42.575300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:42.586125 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:42.587631 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:42.599268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1259/2547] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:49.324765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57e1a5-0515-474a-99f9-7514ae617cc4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:49.324765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57e1a5-0515-474a-99f9-7514ae617cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:49.324765 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57e1a5-0515-474a-99f9-7514ae617cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:49.356767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7a57e1a5-0515-474a-99f9-7514ae617cc4 None None] MFA Rules not processed for user `79b37b77e3e44797b58ef9dd89747ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:49.358619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7a57e1a5-0515-474a-99f9-7514ae617cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:49.433676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1289/2548] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:49.439585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:49.451301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46447-de99-4520-9119-5ae715d4bba2 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:49.456271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:49.456896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:49.457174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:49.457449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:49.458078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:49.460056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:49.577405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1260/2549] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:49 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:49.581845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57e1a5-0515-474a-99f9-7514ae617cc4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:49.593101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57e1a5-0515-474a-99f9-7514ae617cc4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:49.676954 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:49.678048 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:49.678518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:49.678833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:49.679563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:49.681649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:49.788145 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1290/2550] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:49 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:49.790796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:49.804080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeeb6-73a5-4940-80e1-c7f33686d3bd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:49.812109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:49.812109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:49.812109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:49.812109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:49.812830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:49.813049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:49.824795 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1261/2551] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:49.829816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:49.840370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ac51-6861-408b-8fff-0b7ec1237025 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:49.846095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:49.846805 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:49.847088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:49.847368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] PATH_INFO: `/v3/projects/361c3f9f98a54379a89cfdd049abc1df/users/f33b14dcb9164f6c88ddcc05162b3db1/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:49.864356 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=361c3f9f98a54379a89cfdd049abc1df, user_id=f33b14dcb9164f6c88ddcc05162b3db1, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:49.869228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:49.961823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1291/2552] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:49 2022] PUT /identity/v3/projects/361c3f9f98a54379a89cfdd049abc1df/users/f33b14dcb9164f6c88ddcc05162b3db1/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:49.967003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:49.977561 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00cf89-50d5-4130-93e9-5863d145cdb5 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:50.025040 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:50.048467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e05fb-032c-4ac8-9624-da59679ca750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:50.049351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e05fb-032c-4ac8-9624-da59679ca750 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:50.049717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e05fb-032c-4ac8-9624-da59679ca750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:50.050222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e05fb-032c-4ac8-9624-da59679ca750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:50.051003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e05fb-032c-4ac8-9624-da59679ca750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:50.052674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e05fb-032c-4ac8-9624-da59679ca750 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:50.065671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1262/2553] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:50.069790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:50.082664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7017b-cdf0-43b8-84c4-aab92da384ea admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:50.092301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:50.092536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:50.092645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:50.092932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] PATH_INFO: `/v3/projects/361c3f9f98a54379a89cfdd049abc1df/users/f33b14dcb9164f6c88ddcc05162b3db1/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:50.095639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=361c3f9f98a54379a89cfdd049abc1df, user_id=f33b14dcb9164f6c88ddcc05162b3db1, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:50.100992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:50.111408 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1292/2554] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:50 2022] PUT /identity/v3/projects/361c3f9f98a54379a89cfdd049abc1df/users/f33b14dcb9164f6c88ddcc05162b3db1/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:56.538284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65503591-1c19-4632-8510-5828147545eb None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.538968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65503591-1c19-4632-8510-5828147545eb None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.538968 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65503591-1c19-4632-8510-5828147545eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.576392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-65503591-1c19-4632-8510-5828147545eb None None] MFA Rules not processed for user `f33b14dcb9164f6c88ddcc05162b3db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:56.578324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-65503591-1c19-4632-8510-5828147545eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:56.667669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1263/2555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:56.686816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:56.689115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:56.720441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:56.806336 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212284-9d09-4761-8311-d13b120d92dd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:56.812686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:56.813730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.814023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.814308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.889405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:56.892302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:56.901568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1293/2556] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:01.728338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65503591-1c19-4632-8510-5828147545eb None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:01.731200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-65503591-1c19-4632-8510-5828147545eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:01.932038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65503591-1c19-4632-8510-5828147545eb None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:01.941906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cae98-febd-4003-a863-32a2b5859f1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:01.941906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cae98-febd-4003-a863-32a2b5859f1e service placement] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:01.941906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cae98-febd-4003-a863-32a2b5859f1e service placement] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:01.941906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cae98-febd-4003-a863-32a2b5859f1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:01.944301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a35cae98-febd-4003-a863-32a2b5859f1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:01.963294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cae98-febd-4003-a863-32a2b5859f1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:01.965341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cae98-febd-4003-a863-32a2b5859f1e service placement] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:01.981217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1264/2557] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:07.037723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=54 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:08.209120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:08.286194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9d7f9-eea1-490c-9ac5-1e23f3ec4e73 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:08.290542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:08.291392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:08.291858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:08.292089 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:08.295120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:08.402645 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:08.404450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:08.419241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1294/2558] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:10.698495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848253a-4361-45fa-8430-fb6e9fedf4a5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:10.699581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848253a-4361-45fa-8430-fb6e9fedf4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:10.700097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848253a-4361-45fa-8430-fb6e9fedf4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:10.736327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c848253a-4361-45fa-8430-fb6e9fedf4a5 None None] MFA Rules not processed for user `d3375fbaa62241cf83dd214b21d742b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:10.738556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c848253a-4361-45fa-8430-fb6e9fedf4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:10.788037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:10.841588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1265/2559] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:13.684058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:13.686153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:13.716072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15161-89b6-4cd2-95b1-5c6c954f3a58 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:13.723342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:13.724232 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:13.724630 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:13.724994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] PATH_INFO: `/v3/users/3355014e725048949595575341c69c9c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:13.726688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3355014e725048949595575341c69c9c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:13.730545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:14.023465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3355014e725048949595575341c69c9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.041045 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3355014e725048949595575341c69c9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.052973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3355014e725048949595575341c69c9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.054104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3355014e725048949595575341c69c9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.136448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1a45eb-e42c-45b7-ab41-55b3bc8971c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3355014e725048949595575341c69c9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.149215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1295/2560] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:13 2022] DELETE /identity/v3/users/3355014e725048949595575341c69c9c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:14.506063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848253a-4361-45fa-8430-fb6e9fedf4a5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:14.520759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848253a-4361-45fa-8430-fb6e9fedf4a5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:14.607103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:14.607718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:14.608085 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:14.608483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] PATH_INFO: `/v3/projects/7052604e37f4405bb5ccf8ffff694369` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:14.609949 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7052604e37f4405bb5ccf8ffff694369)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:14.611956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:14.812583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7052604e37f4405bb5ccf8ffff694369', 'request_id': 'req-301f19b1-5126-407a-aa23-426711a7eff2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.818221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7052604e37f4405bb5ccf8ffff694369', 'request_id': 'req-301f19b1-5126-407a-aa23-426711a7eff2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.917401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7052604e37f4405bb5ccf8ffff694369', 'request_id': 'req-301f19b1-5126-407a-aa23-426711a7eff2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.930885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] The token cache is being invalidate because project 7052604e37f4405bb5ccf8ffff694369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:14.931293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.932214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-301f19b1-5126-407a-aa23-426711a7eff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:14.933923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1266/2561] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:14 2022] DELETE /identity/v3/projects/7052604e37f4405bb5ccf8ffff694369 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:14.941947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fee17-20a8-4f6a-a168-6489771c9752 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:14.942490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fee17-20a8-4f6a-a168-6489771c9752 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:14.942490 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fee17-20a8-4f6a-a168-6489771c9752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:14.963237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-404fee17-20a8-4f6a-a168-6489771c9752 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:14.964463 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-404fee17-20a8-4f6a-a168-6489771c9752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:14.982322 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:15.029829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1296/2562] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:15.038604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dcea2-2a53-4967-a2fb-634e2c1e5088 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.039240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dcea2-2a53-4967-a2fb-634e2c1e5088 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.039741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dcea2-2a53-4967-a2fb-634e2c1e5088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.067885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4b8dcea2-2a53-4967-a2fb-634e2c1e5088 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:15.067885 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4b8dcea2-2a53-4967-a2fb-634e2c1e5088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:15.074741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1267/2563] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:15.079114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fee17-20a8-4f6a-a168-6489771c9752 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:15.089349 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fee17-20a8-4f6a-a168-6489771c9752 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:15.095247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:15.096516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.096965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.097849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.098748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:30:15.099944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:15.101494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.119315 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1297/2564] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:30:15.124134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dcea2-2a53-4967-a2fb-634e2c1e5088 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:15.135311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dcea2-2a53-4967-a2fb-634e2c1e5088 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:15.141326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:15.142043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.142326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.142665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.143575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:15.146221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.407355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1268/2565] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:15 2022] POST /identity/v3/projects => generated 379 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:15.411646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:15.429803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b703b-1c48-453c-b862-a8deabf79f7c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:15.524257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:15.525331 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.525685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.526080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.526932 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:15.530060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.659623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1298/2566] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:15 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:15.664597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:15.681525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640975b1-4069-4bbf-a9ce-7f7b82fcbe7b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:15.690536 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:15.695120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.695120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.695120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.695120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:15.695120 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.709548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1269/2567] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:15.713535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:15.725238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefcd66-f50e-424d-a77b-263c08e62a2b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:15.730819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21722934-7d1c-4635-a93a-f386b9674256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:15.731473 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21722934-7d1c-4635-a93a-f386b9674256 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.731753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21722934-7d1c-4635-a93a-f386b9674256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.732037 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21722934-7d1c-4635-a93a-f386b9674256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.732697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21722934-7d1c-4635-a93a-f386b9674256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:15.735223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21722934-7d1c-4635-a93a-f386b9674256 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.758865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1299/2568] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:15.768936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:15.788201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a908b-144b-4605-a342-ef0bae902cb1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:15.796877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:15.799013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.799504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.800128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] PATH_INFO: `/v3/projects/5c362aa5bca3401c8b739841c58156d7/users/4ef96d44606047e590738fe4aed82200/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.827067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c362aa5bca3401c8b739841c58156d7, user_id=4ef96d44606047e590738fe4aed82200, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:15.833569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.955672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1270/2569] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:15 2022] PUT /identity/v3/projects/5c362aa5bca3401c8b739841c58156d7/users/4ef96d44606047e590738fe4aed82200/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:15.968271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a09a8-870d-4bf9-8e61-ac36376c92c3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.969137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a09a8-870d-4bf9-8e61-ac36376c92c3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.969313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a09a8-870d-4bf9-8e61-ac36376c92c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.009084 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-265a09a8-870d-4bf9-8e61-ac36376c92c3 None None] MFA Rules not processed for user `4ef96d44606047e590738fe4aed82200`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:16.010087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-265a09a8-870d-4bf9-8e61-ac36376c92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:16.107404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1300/2570] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:16.112440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.120863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:16.205836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101f52-1823-4b7b-a490-0eefc074e61a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:16.211146 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:16.211833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.212172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.212452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.213132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:16.215412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:16.316078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1271/2571] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:16 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:16.322000 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a09a8-870d-4bf9-8e61-ac36376c92c3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.329573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a09a8-870d-4bf9-8e61-ac36376c92c3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:16.354027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:16.411540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:16.412944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.412944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.412944 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.413856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:16.416029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:16.519402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1301/2572] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:16 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:16.523533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.534575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3644880-07c1-4166-bec8-e2bf4592d0cf admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:16.539837 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:16.540488 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.540759 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.541015 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.541662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:16.543296 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:16.559204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1272/2573] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:16.563891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.571648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded1d62-e3b2-4e4e-8385-c06c3c0a5d07 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:16.576176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:16.576873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.577329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.577623 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] PATH_INFO: `/v3/projects/41f9cb28a9a248c2bf13aa5ea8026843/users/5e48596620ad4ad9b33ce9be244a05c7/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.594693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f9cb28a9a248c2bf13aa5ea8026843, user_id=5e48596620ad4ad9b33ce9be244a05c7, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:16.597487 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:16.684039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1302/2574] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:16 2022] PUT /identity/v3/projects/41f9cb28a9a248c2bf13aa5ea8026843/users/5e48596620ad4ad9b33ce9be244a05c7/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:16.688849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.700847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e1f5f-4546-4f54-a189-6577df5515db admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:16.769864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03268729-ca08-4363-9edb-73a9e481be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:16.770527 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268729-ca08-4363-9edb-73a9e481be2d admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.770951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268729-ca08-4363-9edb-73a9e481be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.771302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268729-ca08-4363-9edb-73a9e481be2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.772088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03268729-ca08-4363-9edb-73a9e481be2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:16.773821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03268729-ca08-4363-9edb-73a9e481be2d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:16.786148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1273/2575] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:16.793418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.801823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d91253-7835-4431-bed0-3c6ee9907243 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:16.808412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:16.809133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.809486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.809828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] PATH_INFO: `/v3/projects/41f9cb28a9a248c2bf13aa5ea8026843/users/5e48596620ad4ad9b33ce9be244a05c7/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.811923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f9cb28a9a248c2bf13aa5ea8026843, user_id=5e48596620ad4ad9b33ce9be244a05c7, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:16.817049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:16.830361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1303/2576] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:16 2022] PUT /identity/v3/projects/41f9cb28a9a248c2bf13aa5ea8026843/users/5e48596620ad4ad9b33ce9be244a05c7/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:16.840694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af198-0c40-4b89-9e38-53cddadc6271 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.840981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af198-0c40-4b89-9e38-53cddadc6271 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.841286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af198-0c40-4b89-9e38-53cddadc6271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.876449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c85af198-0c40-4b89-9e38-53cddadc6271 None None] MFA Rules not processed for user `5e48596620ad4ad9b33ce9be244a05c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:16.877870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c85af198-0c40-4b89-9e38-53cddadc6271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:16.959831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:16.963543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1274/2577] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:16.975304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.977031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:17.042819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587ecc3-3047-454b-8142-438fa074bce2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.046714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86501590-c503-4caa-a4b9-c6a16fb4d8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.048334 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501590-c503-4caa-a4b9-c6a16fb4d8ba service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.048721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501590-c503-4caa-a4b9-c6a16fb4d8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.048912 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501590-c503-4caa-a4b9-c6a16fb4d8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.060017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86501590-c503-4caa-a4b9-c6a16fb4d8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.061778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86501590-c503-4caa-a4b9-c6a16fb4d8ba service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.078414 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1304/2578] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:17.289579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85af198-0c40-4b89-9e38-53cddadc6271 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.300762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85af198-0c40-4b89-9e38-53cddadc6271 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.304326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.304940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.305225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.305537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.366944 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.368425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.378394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1275/2579] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:19.721355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763c7c-65d8-4968-96fd-1942991cd82f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:19.721939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763c7c-65d8-4968-96fd-1942991cd82f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:19.721939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763c7c-65d8-4968-96fd-1942991cd82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:19.742386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f6763c7c-65d8-4968-96fd-1942991cd82f None None] MFA Rules not processed for user `79b37b77e3e44797b58ef9dd89747ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:19.743680 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f6763c7c-65d8-4968-96fd-1942991cd82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:19.810086 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1305/2580] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:27.373719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=28 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:29.802869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:31.008055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:31.129954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e0c23-469d-4427-abf9-8692e4f32807 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:31.137904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:31.139038 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:31.139537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:31.140018 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] PATH_INFO: `/v3/users/4ef96d44606047e590738fe4aed82200` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:31.142059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef96d44606047e590738fe4aed82200)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:31.146619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:31.399322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef96d44606047e590738fe4aed82200'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:31.415111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef96d44606047e590738fe4aed82200'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:31.415859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef96d44606047e590738fe4aed82200'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:31.518202 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef96d44606047e590738fe4aed82200'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:31.518998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef96d44606047e590738fe4aed82200'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:31.534614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1276/2581] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:31 2022] DELETE /identity/v3/users/4ef96d44606047e590738fe4aed82200 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:31.540647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:31.541227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:31.541368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:31.574471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:31.576515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:31.666708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1306/2582] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:31.680541 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:31.684421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:31.784993 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cfe93-6154-408a-bba7-ec36f638b64a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:31.791538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:31.792543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:31.793116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:31.793556 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:31.811954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:31.813892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:31.831803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1277/2583] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:32.336141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:32.336141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:32.349381 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456a2e2-e391-4144-bbae-fd364b466b74 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:32.355243 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:32.364020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:32.364020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:32.364020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] PATH_INFO: `/v3/projects/5c362aa5bca3401c8b739841c58156d7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:32.364020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c362aa5bca3401c8b739841c58156d7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:32.364020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:32.530223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c362aa5bca3401c8b739841c58156d7', 'request_id': 'req-74893e69-ff35-4180-925e-7ad39f172a4c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:32.537950 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c362aa5bca3401c8b739841c58156d7', 'request_id': 'req-74893e69-ff35-4180-925e-7ad39f172a4c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:32.702118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c362aa5bca3401c8b739841c58156d7', 'request_id': 'req-74893e69-ff35-4180-925e-7ad39f172a4c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:32.721006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] The token cache is being invalidate because project 5c362aa5bca3401c8b739841c58156d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:32.721441 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:32.722179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:32.723742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1307/2584] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:32 2022] DELETE /identity/v3/projects/5c362aa5bca3401c8b739841c58156d7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:32.730598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:32.740819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b94a3-eec0-40d0-8a8d-ae0d4555ad64 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:32.765051 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:32.813984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:32.814811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:32.815110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:32.815408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] PATH_INFO: `/v3/users/5e48596620ad4ad9b33ce9be244a05c7` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:32.816777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e48596620ad4ad9b33ce9be244a05c7)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:32.819026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:33.220850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e48596620ad4ad9b33ce9be244a05c7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:33.235807 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e48596620ad4ad9b33ce9be244a05c7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:33.236618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e48596620ad4ad9b33ce9be244a05c7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:33.381857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e48596620ad4ad9b33ce9be244a05c7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:33.382494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5b62c2b6-5ae1-409d-a486-0877d0758f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e48596620ad4ad9b33ce9be244a05c7'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:33.399629 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1278/2585] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:32 2022] DELETE /identity/v3/users/5e48596620ad4ad9b33ce9be244a05c7 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:30:33.963210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:33.965708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:33.991516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74893e69-ff35-4180-925e-7ad39f172a4c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:34.069032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:34.069591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.069874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.070148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] PATH_INFO: `/v3/projects/41f9cb28a9a248c2bf13aa5ea8026843` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.071508 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f9cb28a9a248c2bf13aa5ea8026843)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:34.073581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:34.178178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:34.198543 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f9cb28a9a248c2bf13aa5ea8026843', 'request_id': 'req-d3cd6beb-9f68-41ed-801b-fb8085537a9f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:34.207517 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f9cb28a9a248c2bf13aa5ea8026843', 'request_id': 'req-d3cd6beb-9f68-41ed-801b-fb8085537a9f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:34.313598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f9cb28a9a248c2bf13aa5ea8026843', 'request_id': 'req-d3cd6beb-9f68-41ed-801b-fb8085537a9f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:34.334294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] The token cache is being invalidate because project 41f9cb28a9a248c2bf13aa5ea8026843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:34.334844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:34.336144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d3cd6beb-9f68-41ed-801b-fb8085537a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:34.339025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1308/2586] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:33 2022] DELETE /identity/v3/projects/41f9cb28a9a248c2bf13aa5ea8026843 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:34.346472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2e3b-6d5e-44ab-b3b4-1241f0250e4a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.347280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2e3b-6d5e-44ab-b3b4-1241f0250e4a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.347597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2e3b-6d5e-44ab-b3b4-1241f0250e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.372498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-037b2e3b-6d5e-44ab-b3b4-1241f0250e4a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:34.373790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-037b2e3b-6d5e-44ab-b3b4-1241f0250e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:34.447074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1279/2587] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:34.455540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaa67-55ed-40e6-9c44-3c1e5fb83970 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.455826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaa67-55ed-40e6-9c44-3c1e5fb83970 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.456088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaa67-55ed-40e6-9c44-3c1e5fb83970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.478319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7f8aaa67-55ed-40e6-9c44-3c1e5fb83970 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:34.483269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7f8aaa67-55ed-40e6-9c44-3c1e5fb83970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:34.490608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1309/2588] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:34.496088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b2e3b-6d5e-44ab-b3b4-1241f0250e4a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:34.508734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b2e3b-6d5e-44ab-b3b4-1241f0250e4a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:34.513733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:34.514460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.514791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.515070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.515747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:30:34.516061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:34.517799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:34.532043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1280/2589] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:30:34.538411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aaa67-55ed-40e6-9c44-3c1e5fb83970 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:34.549226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aaa67-55ed-40e6-9c44-3c1e5fb83970 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:34.554593 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:34.555277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.555559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.557834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.557834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:34.558482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:34.650873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1310/2590] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:34 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:34.655442 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:34.669084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc287-b6da-4237-9b1a-6438d36c0355 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:34.701619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:34.742148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:34.743289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.744025 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.744591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.746211 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:34.750023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:34.909227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1281/2591] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:34 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:34.913716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:34.926255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8c346-9514-46ab-aa4e-1b081aec96d6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:34.931131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:34.931750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.932029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.932462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.933051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:34.934821 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:34.947648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1311/2592] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:30:34.952170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:34.964001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b72b53-9e92-4187-9aa4-1f129fdc82b4 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:34.969070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f880e-8aaa-4e29-8d87-87ee6b9b964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:34.970375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f880e-8aaa-4e29-8d87-87ee6b9b964b admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:34.970862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f880e-8aaa-4e29-8d87-87ee6b9b964b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:34.971371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f880e-8aaa-4e29-8d87-87ee6b9b964b admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:34.972071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f880e-8aaa-4e29-8d87-87ee6b9b964b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:34.973750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f880e-8aaa-4e29-8d87-87ee6b9b964b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:34.986201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1282/2593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:30:34.993170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:35.006482 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084b92-e553-4988-a6c2-4de4ce387af0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:35.013573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:35.014272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:35.014588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:35.014908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] PATH_INFO: `/v3/projects/65fedc16872e47b7a9ae8e4c972e70a4/users/21fdabea3a1a4e049206ba0e25615cc7/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:35.035187 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65fedc16872e47b7a9ae8e4c972e70a4, user_id=21fdabea3a1a4e049206ba0e25615cc7, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:35.038036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:35.119831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1312/2594] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:34 2022] PUT /identity/v3/projects/65fedc16872e47b7a9ae8e4c972e70a4/users/21fdabea3a1a4e049206ba0e25615cc7/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:35.133817 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f918c05-6d99-4a68-943b-67a315da7443 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:35.134131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f918c05-6d99-4a68-943b-67a315da7443 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:35.134481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f918c05-6d99-4a68-943b-67a315da7443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:35.170992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5f918c05-6d99-4a68-943b-67a315da7443 None None] MFA Rules not processed for user `21fdabea3a1a4e049206ba0e25615cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:35.170992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5f918c05-6d99-4a68-943b-67a315da7443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:35.254255 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1283/2595] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:35.259255 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:35.346272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58834ce3-fc78-4735-b1ab-2637960b7861 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:35.354227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:35.354227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:35.354227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:35.354227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:35.354965 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:35.356753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:35.505911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1313/2596] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:35 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:35.511492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f918c05-6d99-4a68-943b-67a315da7443 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:35.532362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f918c05-6d99-4a68-943b-67a315da7443 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:35.629825 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:35.630966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:35.631413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:35.631876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:35.632984 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:35.636924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:35.744053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1284/2597] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:35 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:35.747609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:35.761142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b584c-264d-4f76-b87c-8e5b1e197b9c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:35.766016 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:35.767419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:35.767707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:35.767988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:35.768661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:35.770341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:35.783064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1314/2598] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:30:35.787668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:35.799966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61849d-3084-4a97-8776-49ae199ebf18 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:35.805401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:35.806103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:35.806386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:35.806701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] PATH_INFO: `/v3/projects/59410fe1a6364e8bab46db94b330c30f/users/7642af8f040747e08c05f6185563d61f/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:35.823923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=59410fe1a6364e8bab46db94b330c30f, user_id=7642af8f040747e08c05f6185563d61f, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:35.826703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:35.917991 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1285/2599] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:35 2022] PUT /identity/v3/projects/59410fe1a6364e8bab46db94b330c30f/users/7642af8f040747e08c05f6185563d61f/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:35.923052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:35.935281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fed43e-9e26-4b26-9ccb-813bbeaa7968 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:35.962215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:36.008150 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc928b-640c-41ac-9576-c52084d4ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:36.008834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc928b-640c-41ac-9576-c52084d4ffc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:36.009034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc928b-640c-41ac-9576-c52084d4ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:36.009313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc928b-640c-41ac-9576-c52084d4ffc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:36.010011 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc928b-640c-41ac-9576-c52084d4ffc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:36.011707 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc928b-640c-41ac-9576-c52084d4ffc1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:36.024188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1315/2600] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:36.029135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:36.036401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:36.042953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253c5a7-f9cd-4a95-bad7-c9077018b8cd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:36.050075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:36.050075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:36.050075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:36.050075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] PATH_INFO: `/v3/projects/59410fe1a6364e8bab46db94b330c30f/users/7642af8f040747e08c05f6185563d61f/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:36.052031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59410fe1a6364e8bab46db94b330c30f, user_id=7642af8f040747e08c05f6185563d61f, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:36.054854 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:36.069246 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1286/2601] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:36 2022] PUT /identity/v3/projects/59410fe1a6364e8bab46db94b330c30f/users/7642af8f040747e08c05f6185563d61f/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:36.081632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3952e58-9ca1-4bbe-a98b-343f4c149d66 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:36.081917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3952e58-9ca1-4bbe-a98b-343f4c149d66 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:36.082199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3952e58-9ca1-4bbe-a98b-343f4c149d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:36.115670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f3952e58-9ca1-4bbe-a98b-343f4c149d66 None None] MFA Rules not processed for user `7642af8f040747e08c05f6185563d61f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:36.117007 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f3952e58-9ca1-4bbe-a98b-343f4c149d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:36.242099 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1316/2602] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:30:36.253505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:36.255381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:36.325232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a937-67bf-4602-8c84-7dfac704aca2 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:36.329941 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083eb95-0ae7-4613-a00f-ad8fdc06e532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:36.330653 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083eb95-0ae7-4613-a00f-ad8fdc06e532 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:36.330990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083eb95-0ae7-4613-a00f-ad8fdc06e532 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:36.331265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083eb95-0ae7-4613-a00f-ad8fdc06e532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:36.341374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083eb95-0ae7-4613-a00f-ad8fdc06e532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:36.342852 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083eb95-0ae7-4613-a00f-ad8fdc06e532 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:36.355193 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1287/2603] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:40.386005 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3952e58-9ca1-4bbe-a98b-343f4c149d66 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:40.495980 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3952e58-9ca1-4bbe-a98b-343f4c149d66 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:40.501855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:40.502534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:40.502864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:40.503200 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] PATH_INFO: `/v3/users/21fdabea3a1a4e049206ba0e25615cc7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:40.504443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21fdabea3a1a4e049206ba0e25615cc7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:40.506686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:40.798465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21fdabea3a1a4e049206ba0e25615cc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:40.800079 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:40.816818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21fdabea3a1a4e049206ba0e25615cc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:40.825380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21fdabea3a1a4e049206ba0e25615cc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:40.826188 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21fdabea3a1a4e049206ba0e25615cc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:40.982170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21fdabea3a1a4e049206ba0e25615cc7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:40.990338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1317/2604] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:40 2022] DELETE /identity/v3/users/21fdabea3a1a4e049206ba0e25615cc7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:40.995357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:40.995935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:40.996036 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:41.019143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:41.020393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:41.093824 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1288/2605] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:41.107638 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:41.109443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:41.196656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d541c03-f986-4f13-89af-597713e2df8c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:41.200352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:41.201033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:41.201324 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:41.201597 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:41.213059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:41.214533 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:41.228660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1318/2606] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:41.838862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:41.846441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:41.863489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5fd02-599a-4959-8a22-dc9258706599 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:41.873331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:41.874228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:41.874375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:41.874734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] PATH_INFO: `/v3/projects/65fedc16872e47b7a9ae8e4c972e70a4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:41.877239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65fedc16872e47b7a9ae8e4c972e70a4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:41.879262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:42.081001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65fedc16872e47b7a9ae8e4c972e70a4', 'request_id': 'req-42be4925-0d7f-48f2-a933-1d2376a06171'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.091076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65fedc16872e47b7a9ae8e4c972e70a4', 'request_id': 'req-42be4925-0d7f-48f2-a933-1d2376a06171'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.142766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:42.156392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadcb3c-0853-4604-903a-cac108aad7c3 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:42.191676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65fedc16872e47b7a9ae8e4c972e70a4', 'request_id': 'req-42be4925-0d7f-48f2-a933-1d2376a06171'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.208742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] The token cache is being invalidate because project 65fedc16872e47b7a9ae8e4c972e70a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:42.210565 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.212049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.217546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1289/2607] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:41 2022] DELETE /identity/v3/projects/65fedc16872e47b7a9ae8e4c972e70a4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:42.226804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:42.227438 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:42.227658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:42.227792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:42.227987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:42.229778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:42.230257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:42.265356 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:42.325797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be4925-0d7f-48f2-a933-1d2376a06171 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:42.337682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:42.338797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:42.339286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:42.339763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] PATH_INFO: `/v3/users/7642af8f040747e08c05f6185563d61f` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:42.341810 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7642af8f040747e08c05f6185563d61f)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:42.346039 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:42.353906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:42.355890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:42.367874 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1319/2608] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:30:42.632503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7642af8f040747e08c05f6185563d61f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.658491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7642af8f040747e08c05f6185563d61f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.659647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7642af8f040747e08c05f6185563d61f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.753478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7642af8f040747e08c05f6185563d61f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.754066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6c96c28b-a511-466a-b0f0-12400fb695ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7642af8f040747e08c05f6185563d61f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:42.778287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1290/2609] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:42 2022] DELETE /identity/v3/users/7642af8f040747e08c05f6185563d61f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:30:43.300085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:43.312712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe6fc-d7a8-4cc5-9e67-381f07109cc7 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:43.350583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:43.428833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:43.429554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:43.429838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:43.430108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] PATH_INFO: `/v3/projects/59410fe1a6364e8bab46db94b330c30f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:43.434871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59410fe1a6364e8bab46db94b330c30f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:43.436905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:43.616657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59410fe1a6364e8bab46db94b330c30f', 'request_id': 'req-6904a501-9560-4f94-ae71-bff4638e124c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:43.624803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59410fe1a6364e8bab46db94b330c30f', 'request_id': 'req-6904a501-9560-4f94-ae71-bff4638e124c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:43.753943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59410fe1a6364e8bab46db94b330c30f', 'request_id': 'req-6904a501-9560-4f94-ae71-bff4638e124c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:43.772226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] The token cache is being invalidate because project 59410fe1a6364e8bab46db94b330c30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:43.772724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:43.773816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6904a501-9560-4f94-ae71-bff4638e124c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:43.776933 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1320/2610] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:43 2022] DELETE /identity/v3/projects/59410fe1a6364e8bab46db94b330c30f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:30:43.784717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a87-db43-4768-8a34-3715c856456a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:43.785995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a87-db43-4768-8a34-3715c856456a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:43.792893 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a87-db43-4768-8a34-3715c856456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:43.811642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-8d241a87-db43-4768-8a34-3715c856456a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:43.813800 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-8d241a87-db43-4768-8a34-3715c856456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:43.893870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1291/2611] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:43.905559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28829981-3b52-4269-a5b9-a67584540f3a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:43.905867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28829981-3b52-4269-a5b9-a67584540f3a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:43.906040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28829981-3b52-4269-a5b9-a67584540f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:43.930881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-28829981-3b52-4269-a5b9-a67584540f3a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:43.932595 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-28829981-3b52-4269-a5b9-a67584540f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:43.951927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a87-db43-4768-8a34-3715c856456a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:43.952711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1321/2612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:43.967823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a87-db43-4768-8a34-3715c856456a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:43.980936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:43.982406 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:43.982947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:43.983458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:43.984686 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:30:43.985866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:43.990811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:44.009110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1292/2613] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:30:44.014076 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28829981-3b52-4269-a5b9-a67584540f3a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:44.026404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28829981-3b52-4269-a5b9-a67584540f3a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:44.032481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:44.033433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.033719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.034075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.034773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:44.036889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:44.156675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1322/2614] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:44 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:44.161661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:44.174921 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286400-6f92-4f9c-ad43-bae946ba9b3a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:44.198320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:44.241047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:44.241673 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.241961 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.242419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.243111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:44.245337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:44.360900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1293/2615] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:44 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:30:44.365302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:44.383017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53e53-2ee9-479c-85c8-560e3d80da7e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:44.391223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:44.392263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.392639 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.392995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.393801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:44.395918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:44.410290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1323/2616] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:44.414403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:44.429555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf8f7-3d35-48c7-8060-7bd8cceeff5f admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:44.435613 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f72d2-63c5-4196-8636-8263fa1513de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:44.441645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f72d2-63c5-4196-8636-8263fa1513de admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.441645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f72d2-63c5-4196-8636-8263fa1513de admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.441645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f72d2-63c5-4196-8636-8263fa1513de admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.441645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f72d2-63c5-4196-8636-8263fa1513de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:44.441645 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f72d2-63c5-4196-8636-8263fa1513de admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:44.453187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1294/2617] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:44.457292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:44.476327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20985ac-0bf9-456b-b96b-6688349718f4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:44.484178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:44.485961 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.490637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.490637 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] PATH_INFO: `/v3/projects/9f6155c1020541bbbe71a86dc497430a/users/0795053310674b61aec88c27574116ad/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.508082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6155c1020541bbbe71a86dc497430a, user_id=0795053310674b61aec88c27574116ad, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:44.511375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:44.605906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1324/2618] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:44 2022] PUT /identity/v3/projects/9f6155c1020541bbbe71a86dc497430a/users/0795053310674b61aec88c27574116ad/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:44.617699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f471448-c4a6-49c3-9161-7d09d68cefc7 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.618216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f471448-c4a6-49c3-9161-7d09d68cefc7 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.618583 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f471448-c4a6-49c3-9161-7d09d68cefc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.662320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5f471448-c4a6-49c3-9161-7d09d68cefc7 None None] MFA Rules not processed for user `0795053310674b61aec88c27574116ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:44.663766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5f471448-c4a6-49c3-9161-7d09d68cefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:44.760103 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1295/2619] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:44.764900 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:44.843185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:44.870460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a9ff8-0e4c-43b3-be00-257bf9738625 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:44.878518 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:44.879418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.879902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.880371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.881288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:44.883675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:45.002327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1325/2620] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:44 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:45.004046 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f471448-c4a6-49c3-9161-7d09d68cefc7 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.017589 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f471448-c4a6-49c3-9161-7d09d68cefc7 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.088943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.089752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.090236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.090910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.092495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.094977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:45.229503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1296/2621] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:45 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:30:45.233791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.263819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d92348-4a18-446a-9327-ed00605ae7c8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.270141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.272246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.272569 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.272846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.273609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.275599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:45.299197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1326/2622] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:45.302897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.320212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f72a-e349-4a06-a224-cc71dda20e13 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.327692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.328353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.329627 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.329926 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] PATH_INFO: `/v3/projects/dd3ae287e4b44e3183584b6e39e076ff/users/d50a6a75322a450b9cbef9200481988e/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.351712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3ae287e4b44e3183584b6e39e076ff, user_id=d50a6a75322a450b9cbef9200481988e, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.357479 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:45.358874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:45.440996 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1297/2623] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:45 2022] PUT /identity/v3/projects/dd3ae287e4b44e3183584b6e39e076ff/users/d50a6a75322a450b9cbef9200481988e/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:45.445279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.469481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98701-1445-46a6-b3da-6d5671162a62 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.571128 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05465d9-a6ce-4e12-8518-4ff249b2138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.571789 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05465d9-a6ce-4e12-8518-4ff249b2138b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.572773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05465d9-a6ce-4e12-8518-4ff249b2138b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.573529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05465d9-a6ce-4e12-8518-4ff249b2138b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.574202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05465d9-a6ce-4e12-8518-4ff249b2138b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.576488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05465d9-a6ce-4e12-8518-4ff249b2138b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:45.589863 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1327/2624] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:45.598804 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.617943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bc22-094b-44b2-ad4c-125a2f6ca22d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.625020 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.628165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.628165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.628165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] PATH_INFO: `/v3/projects/dd3ae287e4b44e3183584b6e39e076ff/users/d50a6a75322a450b9cbef9200481988e/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.630573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3ae287e4b44e3183584b6e39e076ff, user_id=d50a6a75322a450b9cbef9200481988e, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.635623 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:45.655122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1298/2625] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:45 2022] PUT /identity/v3/projects/dd3ae287e4b44e3183584b6e39e076ff/users/d50a6a75322a450b9cbef9200481988e/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:45.666351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7a2cb-9efc-4f99-817c-046367e72c36 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.666661 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7a2cb-9efc-4f99-817c-046367e72c36 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.666949 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7a2cb-9efc-4f99-817c-046367e72c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.723069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-89e7a2cb-9efc-4f99-817c-046367e72c36 None None] MFA Rules not processed for user `d50a6a75322a450b9cbef9200481988e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:45.724817 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-89e7a2cb-9efc-4f99-817c-046367e72c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:45.826450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1328/2626] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:45.844717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.850395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:45.946523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f947500-2a1d-4f6c-a2fd-a48d3535bac7 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.955518 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.956171 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.956459 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.956738 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.972827 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.974460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:46.003091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1299/2627] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:46.426896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7a2cb-9efc-4f99-817c-046367e72c36 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:46.442458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7a2cb-9efc-4f99-817c-046367e72c36 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:46.447094 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75edfd3-d34f-4e16-96bd-e8bf7bdfea31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:46.449284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75edfd3-d34f-4e16-96bd-e8bf7bdfea31 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:46.449641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75edfd3-d34f-4e16-96bd-e8bf7bdfea31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:46.450091 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75edfd3-d34f-4e16-96bd-e8bf7bdfea31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:46.506828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:46.536280 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75edfd3-d34f-4e16-96bd-e8bf7bdfea31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:46.538077 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75edfd3-d34f-4e16-96bd-e8bf7bdfea31 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:46.553839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1329/2628] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:47.200347 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:47.290232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a456c-0a8e-4c7b-95d2-d5baedad4c44 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:47.295405 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:47.296134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:47.296422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:47.296706 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] PATH_INFO: `/v3/users/0795053310674b61aec88c27574116ad` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:47.298559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0795053310674b61aec88c27574116ad)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:47.301047 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:47.600305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0795053310674b61aec88c27574116ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.621606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0795053310674b61aec88c27574116ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.622293 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0795053310674b61aec88c27574116ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.718922 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0795053310674b61aec88c27574116ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.720424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0795053310674b61aec88c27574116ad'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.737937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1300/2629] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:47 2022] DELETE /identity/v3/users/0795053310674b61aec88c27574116ad => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:30:47.742759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:47.743236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:47.743346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:47.766724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:47.768290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:47.833818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1330/2630] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:47.843723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:47.848166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:47.856131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:47.914746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ece74-e08d-4a52-82dc-65cbc4551e3e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:47.918762 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:47.919371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:47.919647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:47.920027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:47.931851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:47.933337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:47.944672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1301/2631] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:30:48.445748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:48.447300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:48.462379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd1bf-ef93-44b7-93b4-ad3dce2318c4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:48.469134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:48.470132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:48.470524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:48.470524 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] PATH_INFO: `/v3/projects/9f6155c1020541bbbe71a86dc497430a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:48.471880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6155c1020541bbbe71a86dc497430a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:48.473818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:48.655936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6155c1020541bbbe71a86dc497430a', 'request_id': 'req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:48.662401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6155c1020541bbbe71a86dc497430a', 'request_id': 'req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:48.747133 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6155c1020541bbbe71a86dc497430a', 'request_id': 'req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:48.760724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] The token cache is being invalidate because project 9f6155c1020541bbbe71a86dc497430a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:48.761027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:48.761693 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:48.763614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1331/2632] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:48 2022] DELETE /identity/v3/projects/9f6155c1020541bbbe71a86dc497430a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:48.767558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:48.777877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0a3c-8311-4be2-843a-b16b74e3a61c service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:48.847836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:48.848671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:48.848960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:48.849251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] PATH_INFO: `/v3/users/d50a6a75322a450b9cbef9200481988e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:48.850424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50a6a75322a450b9cbef9200481988e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:48.852386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:49.034578 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50a6a75322a450b9cbef9200481988e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:49.054075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50a6a75322a450b9cbef9200481988e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:49.054950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50a6a75322a450b9cbef9200481988e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:49.141292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50a6a75322a450b9cbef9200481988e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:49.142116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-5ba76b09-e301-4167-9acb-98d0af28339f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50a6a75322a450b9cbef9200481988e'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:49.156683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1302/2633] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:48 2022] DELETE /identity/v3/users/d50a6a75322a450b9cbef9200481988e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:49.689740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:49.693006 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:49.704974 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2e718-e4e1-4a3a-9e6c-5d5abf38505a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:49.775036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:49.775682 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:49.777269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:49.777269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] PATH_INFO: `/v3/projects/dd3ae287e4b44e3183584b6e39e076ff` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:49.777476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3ae287e4b44e3183584b6e39e076ff)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:49.779391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:49.781855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:49.919116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3ae287e4b44e3183584b6e39e076ff', 'request_id': 'req-f30c1a99-57bd-422d-8f52-e6da75cfcd26'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:49.925401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3ae287e4b44e3183584b6e39e076ff', 'request_id': 'req-f30c1a99-57bd-422d-8f52-e6da75cfcd26'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:49.993047 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3ae287e4b44e3183584b6e39e076ff', 'request_id': 'req-f30c1a99-57bd-422d-8f52-e6da75cfcd26'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:50.006712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] The token cache is being invalidate because project dd3ae287e4b44e3183584b6e39e076ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:50.007194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:50.008260 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f30c1a99-57bd-422d-8f52-e6da75cfcd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:50.010819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1332/2634] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:49 2022] DELETE /identity/v3/projects/dd3ae287e4b44e3183584b6e39e076ff => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:50.016032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6131c-78ed-43cc-b8b7-dbb3ebe0ef07 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.016499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6131c-78ed-43cc-b8b7-dbb3ebe0ef07 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.016608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6131c-78ed-43cc-b8b7-dbb3ebe0ef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.037808 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-c4b6131c-78ed-43cc-b8b7-dbb3ebe0ef07 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:50.039070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-c4b6131c-78ed-43cc-b8b7-dbb3ebe0ef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:50.061191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:50.104481 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1303/2635] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:50.114354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad176-f031-4776-a56f-4907a4b5069b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.114665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad176-f031-4776-a56f-4907a4b5069b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.114958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad176-f031-4776-a56f-4907a4b5069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.136425 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ca7ad176-f031-4776-a56f-4907a4b5069b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:50.137656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ca7ad176-f031-4776-a56f-4907a4b5069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:50.145856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1333/2636] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:50.150225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6131c-78ed-43cc-b8b7-dbb3ebe0ef07 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:50.160577 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6131c-78ed-43cc-b8b7-dbb3ebe0ef07 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:50.165372 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:50.165999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.166282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.166562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.167278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:30:50.167574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:50.169309 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:50.186986 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1304/2637] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:30:50.192310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ad176-f031-4776-a56f-4907a4b5069b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:50.202087 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ad176-f031-4776-a56f-4907a4b5069b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:50.207489 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:50.208113 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.208530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.208826 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.209521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:50.211465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:50.305643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1334/2638] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:50 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:30:50.310283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:50.322596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c4c9-b026-4557-8e74-6d0702e517a6 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:50.397731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:50.398471 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.398865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.399387 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.400111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:50.402189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:50.506969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1305/2639] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:50 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:50.511557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:50.525784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937de7a-a8a7-4545-bad0-b6ec024eecab admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:50.530963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:50.531636 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.531918 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.532193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.532850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:50.535308 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:50.547288 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1335/2640] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:30:50.551239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:50.561802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53037b-c2e9-4d66-a32a-8ff41d692a76 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:50.569666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472ac0d-ddf3-4d1b-9d0e-a17fb31c6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:50.570297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472ac0d-ddf3-4d1b-9d0e-a17fb31c6436 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.570582 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472ac0d-ddf3-4d1b-9d0e-a17fb31c6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.571069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472ac0d-ddf3-4d1b-9d0e-a17fb31c6436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.571549 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472ac0d-ddf3-4d1b-9d0e-a17fb31c6436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:50.573205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472ac0d-ddf3-4d1b-9d0e-a17fb31c6436 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:50.585872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1306/2641] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:50.590311 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:50.601598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1733ce-7106-4f30-93ae-5d19846e7de7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:50.606302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:50.607057 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.607338 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.607615 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] PATH_INFO: `/v3/projects/75f0062921d1488491c2cd016e52977b/users/82ee20749a654a23b71496935c06c260/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.625660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f0062921d1488491c2cd016e52977b, user_id=82ee20749a654a23b71496935c06c260, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:50.629266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:50.705829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1336/2642] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:50 2022] PUT /identity/v3/projects/75f0062921d1488491c2cd016e52977b/users/82ee20749a654a23b71496935c06c260/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:50.717161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f31f20-73f1-405b-b57d-49424daea502 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.717447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f31f20-73f1-405b-b57d-49424daea502 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.717723 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f31f20-73f1-405b-b57d-49424daea502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.748248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-63f31f20-73f1-405b-b57d-49424daea502 None None] MFA Rules not processed for user `82ee20749a654a23b71496935c06c260`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:50.749478 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-63f31f20-73f1-405b-b57d-49424daea502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:50.821632 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1307/2643] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:50.826513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:50.900329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff798-73ee-486f-b054-1ec2618cc97b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:50.905540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:50.906174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:50.906460 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:50.906774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:50.907439 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:50.910244 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:51.032835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1337/2644] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:50 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:30:51.038172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f31f20-73f1-405b-b57d-49424daea502 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:51.049444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f31f20-73f1-405b-b57d-49424daea502 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:51.069838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:51.110275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:51.110942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:51.111229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:51.111776 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:51.113558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:51.116266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:51.245716 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1308/2645] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:51 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:51.249751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:51.260742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a397c-dad9-47ba-aeff-a45eebe77102 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:51.265659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:51.266296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:51.266584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:51.266902 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:51.267557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:51.269275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:51.280268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1338/2646] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:51.285350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:51.296460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1e31a-4e9a-4403-a162-70a72ae4c490 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:51.301853 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:51.302526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:51.304832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:51.304832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] PATH_INFO: `/v3/projects/57033f4c3a4d475bbb4ae1a3dc7d9d7d/users/8d22c722e72b46f3a21e2d27f00d6839/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:51.321368 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57033f4c3a4d475bbb4ae1a3dc7d9d7d, user_id=8d22c722e72b46f3a21e2d27f00d6839, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:51.324092 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:51.400450 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1309/2647] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:51 2022] PUT /identity/v3/projects/57033f4c3a4d475bbb4ae1a3dc7d9d7d/users/8d22c722e72b46f3a21e2d27f00d6839/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:30:51.404511 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:51.411790 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:51.418416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8595ab-85dc-4b6c-9edd-45744a45eef3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:51.497029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43424202-5fab-4bd0-9c2c-7de2f4e509a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:51.497640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424202-5fab-4bd0-9c2c-7de2f4e509a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:51.497919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424202-5fab-4bd0-9c2c-7de2f4e509a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:51.498192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424202-5fab-4bd0-9c2c-7de2f4e509a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:51.498923 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43424202-5fab-4bd0-9c2c-7de2f4e509a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:51.500528 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43424202-5fab-4bd0-9c2c-7de2f4e509a5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:51.511730 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1339/2648] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:51.517960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:51.530361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a751e6-a759-416c-9cd0-7b100ff28e2a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:51.536359 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:51.537027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:51.537308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:51.537585 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] PATH_INFO: `/v3/projects/57033f4c3a4d475bbb4ae1a3dc7d9d7d/users/8d22c722e72b46f3a21e2d27f00d6839/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:51.539599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57033f4c3a4d475bbb4ae1a3dc7d9d7d, user_id=8d22c722e72b46f3a21e2d27f00d6839, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:51.542241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:51.554107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1310/2649] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:51 2022] PUT /identity/v3/projects/57033f4c3a4d475bbb4ae1a3dc7d9d7d/users/8d22c722e72b46f3a21e2d27f00d6839/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:51.565137 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:51.565458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:51.565855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:51.597310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] MFA Rules not processed for user `8d22c722e72b46f3a21e2d27f00d6839`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:51.598955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:51.680666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1340/2650] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:30:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:51.693083 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:51.695451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:51.762382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26708-d147-47a5-a907-9524a29fd906 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:51.766417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:51.767115 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:51.767399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:51.767680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:51.829466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:51.831632 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:51.841734 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1311/2651] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:57.233746 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:57.235226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:57.248428 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0680-3385-4561-9b53-94550d68c706 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:57.252110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0549a-1aac-49c3-9aed-5015b8963d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:57.252743 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0549a-1aac-49c3-9aed-5015b8963d35 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:57.253025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0549a-1aac-49c3-9aed-5015b8963d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:57.253301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0549a-1aac-49c3-9aed-5015b8963d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:57.262383 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0549a-1aac-49c3-9aed-5015b8963d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:57.263849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0549a-1aac-49c3-9aed-5015b8963d35 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:57.273389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1341/2652] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:01.837200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:03.245676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:03.312848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543c360-938b-4d1b-b794-b7f16a5ea0d0 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:03.318799 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:03.319538 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:03.319816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:03.320090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] PATH_INFO: `/v3/users/82ee20749a654a23b71496935c06c260` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:03.321250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ee20749a654a23b71496935c06c260)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:03.323233 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:03.526433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ee20749a654a23b71496935c06c260'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:03.539084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ee20749a654a23b71496935c06c260'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:03.539771 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ee20749a654a23b71496935c06c260'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:03.612985 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ee20749a654a23b71496935c06c260'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:03.613596 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ee20749a654a23b71496935c06c260'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:03.627496 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1312/2653] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:03 2022] DELETE /identity/v3/users/82ee20749a654a23b71496935c06c260 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:03.632078 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:03.632551 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:03.632647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:03.651770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:03.652803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:03.716299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1342/2654] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:03.727145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:03.728722 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:03.792443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382b09-111a-465d-82a7-6ec21a5f9e81 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:03.796080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:03.796695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:03.796981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:03.797289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:03.807467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:03.808997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:03.819475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1313/2655] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:04.412329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:04.414192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:04.430521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed3fa7-a7f7-472a-b7fb-e321bf0e7b10 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:04.435907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:04.436667 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:04.436905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:04.437186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] PATH_INFO: `/v3/projects/75f0062921d1488491c2cd016e52977b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:04.438397 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f0062921d1488491c2cd016e52977b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:04.440632 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:04.448196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:04.571793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f0062921d1488491c2cd016e52977b', 'request_id': 'req-16384045-dd19-4bdd-b565-68097ed8095c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:04.577464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f0062921d1488491c2cd016e52977b', 'request_id': 'req-16384045-dd19-4bdd-b565-68097ed8095c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:04.707269 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f0062921d1488491c2cd016e52977b', 'request_id': 'req-16384045-dd19-4bdd-b565-68097ed8095c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:04.720416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] The token cache is being invalidate because project 75f0062921d1488491c2cd016e52977b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:04.720694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:04.721352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:04.722997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1343/2656] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:04 2022] DELETE /identity/v3/projects/75f0062921d1488491c2cd016e52977b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:04.727789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:04.737848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a05d5-cfd8-4718-bd8e-fbe2d91b0ce3 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:04.758031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:04.802547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:04.803357 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:04.803639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:04.803915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] PATH_INFO: `/v3/users/8d22c722e72b46f3a21e2d27f00d6839` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:04.805034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d22c722e72b46f3a21e2d27f00d6839)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:04.807078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:05.010698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d22c722e72b46f3a21e2d27f00d6839'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.023680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d22c722e72b46f3a21e2d27f00d6839'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.024377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d22c722e72b46f3a21e2d27f00d6839'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.098650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d22c722e72b46f3a21e2d27f00d6839'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.099286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-81062bfa-3dee-42b9-9f83-4aef5497ee19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d22c722e72b46f3a21e2d27f00d6839'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.113122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1314/2657] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:04 2022] DELETE /identity/v3/users/8d22c722e72b46f3a21e2d27f00d6839 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:05.576908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:05.578413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:05.594796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16384045-dd19-4bdd-b565-68097ed8095c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:05.658748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:05.658748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:05.658978 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:05.659202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] PATH_INFO: `/v3/projects/57033f4c3a4d475bbb4ae1a3dc7d9d7d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:05.660327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57033f4c3a4d475bbb4ae1a3dc7d9d7d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:05.662267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:05.787945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57033f4c3a4d475bbb4ae1a3dc7d9d7d', 'request_id': 'req-f7a8dea4-0e23-41be-800f-624dcd4f8493'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.794702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57033f4c3a4d475bbb4ae1a3dc7d9d7d', 'request_id': 'req-f7a8dea4-0e23-41be-800f-624dcd4f8493'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.895386 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57033f4c3a4d475bbb4ae1a3dc7d9d7d', 'request_id': 'req-f7a8dea4-0e23-41be-800f-624dcd4f8493'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.908611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] The token cache is being invalidate because project 57033f4c3a4d475bbb4ae1a3dc7d9d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:05.908905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.909596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f7a8dea4-0e23-41be-800f-624dcd4f8493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:05.911146 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1344/2658] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:05 2022] DELETE /identity/v3/projects/57033f4c3a4d475bbb4ae1a3dc7d9d7d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:05.917775 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e77bf-38b6-4fbe-bc34-1ff4c1bd20bf None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:05.918399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e77bf-38b6-4fbe-bc34-1ff4c1bd20bf None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:05.918514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e77bf-38b6-4fbe-bc34-1ff4c1bd20bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:05.946545 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-675e77bf-38b6-4fbe-bc34-1ff4c1bd20bf None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:05.947840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-675e77bf-38b6-4fbe-bc34-1ff4c1bd20bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:06.011295 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1315/2659] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:06.019606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420abf4-7cd1-4195-bc9c-f1ccbda1a123 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.019897 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420abf4-7cd1-4195-bc9c-f1ccbda1a123 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.020183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420abf4-7cd1-4195-bc9c-f1ccbda1a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.041296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1420abf4-7cd1-4195-bc9c-f1ccbda1a123 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:06.042571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1420abf4-7cd1-4195-bc9c-f1ccbda1a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:06.050987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1345/2660] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:06.055730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e77bf-38b6-4fbe-bc34-1ff4c1bd20bf None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.065840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e77bf-38b6-4fbe-bc34-1ff4c1bd20bf None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.071055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.071672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.071950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.072226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.072886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:31:06.073191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.074863 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.088954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1316/2661] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:31:06.093538 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420abf4-7cd1-4195-bc9c-f1ccbda1a123 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.103984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420abf4-7cd1-4195-bc9c-f1ccbda1a123 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.110277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.110982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.111270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.111702 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.112362 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.114388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.134364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:06.309935 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1346/2662] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:31:06 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:06.314268 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.327149 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7df5-df9f-452b-9889-6ae28b83a961 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.360344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:06.393990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.394606 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.394917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.395191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.395846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.398338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.523915 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1317/2663] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:31:06 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:06.525871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.536372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f8a17-0955-45b6-b246-5d288f7fb120 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.544430 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.545248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.551114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.551114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.551114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.551114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.562282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1347/2664] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:06.563436 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.574165 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc4d5-85f3-455b-8e41-c9da5b27de77 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.578982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e2d8f-a9c2-4861-936e-6913841132a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.579591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e2d8f-a9c2-4861-936e-6913841132a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.579876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e2d8f-a9c2-4861-936e-6913841132a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.580153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e2d8f-a9c2-4861-936e-6913841132a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.580796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e2d8f-a9c2-4861-936e-6913841132a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.582422 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e2d8f-a9c2-4861-936e-6913841132a6 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.593877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1318/2665] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:06.598314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.608848 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17094-1624-4ce7-90ae-1efa4f41c126 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.613413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.614195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.614479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.614801 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] PATH_INFO: `/v3/projects/ddbe6edb49d04c1280fba0ceb7c0fada/users/dbf7ee5c2b1b407fa19b032439fba79c/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.630426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbe6edb49d04c1280fba0ceb7c0fada, user_id=dbf7ee5c2b1b407fa19b032439fba79c, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.633731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.730032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1348/2666] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:06 2022] PUT /identity/v3/projects/ddbe6edb49d04c1280fba0ceb7c0fada/users/dbf7ee5c2b1b407fa19b032439fba79c/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:06.742145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.742429 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.742750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.773318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] MFA Rules not processed for user `dbf7ee5c2b1b407fa19b032439fba79c`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:06.774666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:06.844179 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1319/2667] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:06.857033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.859373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:06.924171 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e7871-5b58-4c31-9472-7efbd781d3e8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.928127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e3e10f9efeb4b908bf3d74ce1eb6a3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.928841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.929219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.929503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.941583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.943095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.958199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1349/2668] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:13.087147 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:13.088608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:13.150022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3525e-1026-48f8-b7f8-a2b72d1c8792 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:13.154208 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f867-52c6-41e9-8d68-69b5e2e48fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:13.154904 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f867-52c6-41e9-8d68-69b5e2e48fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:13.155273 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f867-52c6-41e9-8d68-69b5e2e48fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:13.155550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f867-52c6-41e9-8d68-69b5e2e48fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:13.159847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-aa53f867-52c6-41e9-8d68-69b5e2e48fd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:13.214367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:13.236439 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53f867-52c6-41e9-8d68-69b5e2e48fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:13.237898 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53f867-52c6-41e9-8d68-69b5e2e48fd2 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:13.249212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1320/2669] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:16.109034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:16.110573 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:16.170483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2413-3908-42f1-964d-788d8b86b18a service glance] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:16.174745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:16.175763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:16.176246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:16.176734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:16.179132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:16.194248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:16.195767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:16.207641 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1350/2670] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:23.287724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=10 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:24.187175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1b7f-fa8c-4abf-9440-702f986c7d91 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:24.187555 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1b7f-fa8c-4abf-9440-702f986c7d91 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:24.187784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1b7f-fa8c-4abf-9440-702f986c7d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:24.206676 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-399f1b7f-fa8c-4abf-9440-702f986c7d91 None None] MFA Rules not processed for user `d3375fbaa62241cf83dd214b21d742b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:24.207881 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-399f1b7f-fa8c-4abf-9440-702f986c7d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:24.272155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1321/2671] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:25.536049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:25.617316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163ac45-1095-44cc-b162-b243c7ac0aa3 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:25.622319 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:25.622996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:25.623284 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:25.623586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] PATH_INFO: `/v3/users/dbf7ee5c2b1b407fa19b032439fba79c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:25.624729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf7ee5c2b1b407fa19b032439fba79c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:25.626678 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:25.638828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:25.925865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf7ee5c2b1b407fa19b032439fba79c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:25.939402 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf7ee5c2b1b407fa19b032439fba79c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:25.947013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf7ee5c2b1b407fa19b032439fba79c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:25.947767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf7ee5c2b1b407fa19b032439fba79c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:26.035452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf7ee5c2b1b407fa19b032439fba79c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:26.045845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1351/2672] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:25 2022] DELETE /identity/v3/users/dbf7ee5c2b1b407fa19b032439fba79c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:31:26.047950 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:26.048438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:26.048695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:26.069434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:26.071878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:26.150568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1322/2673] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:26.172107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:26.173622 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:26.240423 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660aa3-7d71-448c-bc76-71d9d702ed4d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:26.245326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b59e56-4b51-4e9f-9f45-a15814c0bd93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:26.246433 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59e56-4b51-4e9f-9f45-a15814c0bd93 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:26.246896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59e56-4b51-4e9f-9f45-a15814c0bd93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:26.247322 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59e56-4b51-4e9f-9f45-a15814c0bd93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:26.257751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b59e56-4b51-4e9f-9f45-a15814c0bd93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:26.259770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b59e56-4b51-4e9f-9f45-a15814c0bd93 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:26.269668 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1352/2674] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:26.704814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:26.707022 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:26.731108 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146684ec-f791-4a13-ac35-1c853c4c3270 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:26.739229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:26.739229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:26.739229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:26.739229 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] PATH_INFO: `/v3/projects/ddbe6edb49d04c1280fba0ceb7c0fada` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:26.740109 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbe6edb49d04c1280fba0ceb7c0fada)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:26.741434 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:26.950466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbe6edb49d04c1280fba0ceb7c0fada', 'request_id': 'req-8ff0c661-6ede-4463-9e7e-1b4b1046212f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:26.956021 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbe6edb49d04c1280fba0ceb7c0fada', 'request_id': 'req-8ff0c661-6ede-4463-9e7e-1b4b1046212f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:27.026493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbe6edb49d04c1280fba0ceb7c0fada', 'request_id': 'req-8ff0c661-6ede-4463-9e7e-1b4b1046212f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:27.038923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] The token cache is being invalidate because project ddbe6edb49d04c1280fba0ceb7c0fada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:27.039218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:27.039938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-8ff0c661-6ede-4463-9e7e-1b4b1046212f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:27.041504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1323/2675] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:26 2022] DELETE /identity/v3/projects/ddbe6edb49d04c1280fba0ceb7c0fada => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:27.046412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f349a-780b-4d56-8165-442982c24e6b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.047049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f349a-780b-4d56-8165-442982c24e6b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.047147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f349a-780b-4d56-8165-442982c24e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.067299 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3c6f349a-780b-4d56-8165-442982c24e6b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:27.068535 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c6f349a-780b-4d56-8165-442982c24e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:27.131039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1353/2676] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:27.139866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde7bb-67bd-4ec5-96d2-7a756ee5ce9a None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.140421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde7bb-67bd-4ec5-96d2-7a756ee5ce9a None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.140421 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde7bb-67bd-4ec5-96d2-7a756ee5ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.160507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3efde7bb-67bd-4ec5-96d2-7a756ee5ce9a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:27.161750 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3efde7bb-67bd-4ec5-96d2-7a756ee5ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:27.170212 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1324/2677] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:27.174676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f349a-780b-4d56-8165-442982c24e6b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:27.186025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f349a-780b-4d56-8165-442982c24e6b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:27.190859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:27.191471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.191751 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.192033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.192723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:31:27.192979 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:27.195357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:27.208227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1354/2678] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:31:27.212809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde7bb-67bd-4ec5-96d2-7a756ee5ce9a None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:27.223049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde7bb-67bd-4ec5-96d2-7a756ee5ce9a None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:27.228563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:27.229264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.229470 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.229756 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.230410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:27.232380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:27.357173 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:27.363742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1325/2679] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:31:27 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:27.368989 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:27.379582 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822a29-159e-416c-8f89-b9930c473e9f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:27.392437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:27.439400 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:27.440008 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.440294 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.440568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.441205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:27.443190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:27.539175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1355/2680] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:31:27 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:27.543381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:27.553760 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96a9f-6bb0-40dc-b5a8-beb670ad8198 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:27.558408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:27.559144 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.559432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.559710 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.560352 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:27.561940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:27.572590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1326/2681] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:27.576814 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:27.596316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62b47-312a-43f9-b8c7-6ff97c17c604 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:27.596316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75dee9-c73a-45ee-96b6-db7610cf550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:27.596316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75dee9-c73a-45ee-96b6-db7610cf550a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.596316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75dee9-c73a-45ee-96b6-db7610cf550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.596822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75dee9-c73a-45ee-96b6-db7610cf550a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.596822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75dee9-c73a-45ee-96b6-db7610cf550a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:27.597392 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75dee9-c73a-45ee-96b6-db7610cf550a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:27.608164 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1356/2682] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:27.612354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:27.623234 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2398058-6204-4a80-ada6-a8bb3d956c15 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:27.628080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:27.628725 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.629035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.629312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] PATH_INFO: `/v3/projects/52d93d53f87d4cd880caffdb9ff34023/users/cac6d1e894e946468725be27ee41d81b/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.645349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d93d53f87d4cd880caffdb9ff34023, user_id=cac6d1e894e946468725be27ee41d81b, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:27.653948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:27.738654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1327/2683] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:27 2022] PUT /identity/v3/projects/52d93d53f87d4cd880caffdb9ff34023/users/cac6d1e894e946468725be27ee41d81b/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:27.750058 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fd0ae-ae22-4a20-8aa4-a6f461f7b545 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.750351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fd0ae-ae22-4a20-8aa4-a6f461f7b545 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.750673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fd0ae-ae22-4a20-8aa4-a6f461f7b545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.779120 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-168fd0ae-ae22-4a20-8aa4-a6f461f7b545 None None] MFA Rules not processed for user `cac6d1e894e946468725be27ee41d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:27.780343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-168fd0ae-ae22-4a20-8aa4-a6f461f7b545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:27.847577 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1357/2684] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:27.852441 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:27.916666 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e85bbc-cdbb-40bb-a7e5-92f52adfc44f admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:27.921369 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:27.921978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:27.922261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:27.922540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:27.923205 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:27.925244 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:28.074418 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1328/2685] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:31:27 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:28.078752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fd0ae-ae22-4a20-8aa4-a6f461f7b545 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:28.089792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fd0ae-ae22-4a20-8aa4-a6f461f7b545 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:28.147191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:28.147699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:28.147984 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:28.148264 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:28.148905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:28.150884 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:28.276105 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1358/2686] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:31:28 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:28.277446 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:28.289275 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6224-40d5-46e2-8f32-affc5131d8f3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:28.294789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:28.295322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:28.295735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:28.296110 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:28.296864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:28.298695 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:28.320201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1329/2687] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:28.324553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:28.336050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e47d44-f445-4fb9-aed9-3422f265f45e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:28.341062 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:28.341875 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:28.342238 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:28.343589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] PATH_INFO: `/v3/projects/cb5e6dfdb2094727b6378aecb6336082/users/5b9b1965f6754157999428329f6b7139/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:28.355750 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:28.360196 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5e6dfdb2094727b6378aecb6336082, user_id=5b9b1965f6754157999428329f6b7139, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:28.363040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:28.449758 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1359/2688] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:28 2022] PUT /identity/v3/projects/cb5e6dfdb2094727b6378aecb6336082/users/5b9b1965f6754157999428329f6b7139/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:28.454053 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:28.465028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399a20-8477-4a4e-ad2f-5ed680f5a6ab admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:28.532691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da53f3-965b-42df-aab2-22f75cf1bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:28.533451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da53f3-965b-42df-aab2-22f75cf1bc42 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:28.533737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da53f3-965b-42df-aab2-22f75cf1bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:28.534017 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da53f3-965b-42df-aab2-22f75cf1bc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:28.534755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da53f3-965b-42df-aab2-22f75cf1bc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:28.536354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da53f3-965b-42df-aab2-22f75cf1bc42 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:28.549004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1330/2689] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:28.553759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:28.564572 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e513-85a1-439e-810c-cfa0b5ee965f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:28.569831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:28.570494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:28.570807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:28.571096 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] PATH_INFO: `/v3/projects/cb5e6dfdb2094727b6378aecb6336082/users/5b9b1965f6754157999428329f6b7139/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:28.573080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5e6dfdb2094727b6378aecb6336082, user_id=5b9b1965f6754157999428329f6b7139, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:28.575880 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:28.586857 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1360/2690] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:28 2022] PUT /identity/v3/projects/cb5e6dfdb2094727b6378aecb6336082/users/5b9b1965f6754157999428329f6b7139/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:28.598801 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36daf9d-f3b4-46e3-b69d-e9219345854f None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:28.599278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36daf9d-f3b4-46e3-b69d-e9219345854f None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:28.599558 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36daf9d-f3b4-46e3-b69d-e9219345854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:28.630969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e36daf9d-f3b4-46e3-b69d-e9219345854f None None] MFA Rules not processed for user `5b9b1965f6754157999428329f6b7139`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:28.632953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e36daf9d-f3b4-46e3-b69d-e9219345854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:28.658550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:28.706785 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1331/2691] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:28.718443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:28.720195 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:28.783599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e26b5-7a9f-4b4a-b12b-3513daf5e8dd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:28.788372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e18e-9c78-4a24-948f-fcbe9bc0ff33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:28.789125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e18e-9c78-4a24-948f-fcbe9bc0ff33 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:28.789411 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e18e-9c78-4a24-948f-fcbe9bc0ff33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:28.789694 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e18e-9c78-4a24-948f-fcbe9bc0ff33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:28.851708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e18e-9c78-4a24-948f-fcbe9bc0ff33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:28.853340 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e18e-9c78-4a24-948f-fcbe9bc0ff33 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:28.863934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1361/2692] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:32.096906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36daf9d-f3b4-46e3-b69d-e9219345854f None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:32.166604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36daf9d-f3b4-46e3-b69d-e9219345854f None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:32.171320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:32.171965 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:32.172280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:32.172614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] PATH_INFO: `/v3/users/cac6d1e894e946468725be27ee41d81b` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:32.173740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac6d1e894e946468725be27ee41d81b)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:32.175728 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:32.355690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac6d1e894e946468725be27ee41d81b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:32.367964 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac6d1e894e946468725be27ee41d81b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:32.368675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac6d1e894e946468725be27ee41d81b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:32.455395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac6d1e894e946468725be27ee41d81b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:32.456132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac6d1e894e946468725be27ee41d81b'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:32.471473 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1332/2693] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:32 2022] DELETE /identity/v3/users/cac6d1e894e946468725be27ee41d81b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:32.476123 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:32.477279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:32.477279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:32.497879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:32.499230 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:32.562931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1362/2694] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:32.573581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:32.575107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:32.624814 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:32.636996 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d926fa-f5f9-4b5c-ba2e-ce3923205067 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:32.641523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:32.641523 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:32.642033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:32.642033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:32.653209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:32.654664 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:32.665225 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1333/2695] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:33.140108 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:33.141803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:33.157333 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5e30c-46b7-43b7-a9b3-c8ed3ea5b8fd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:33.161388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:33.162041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:33.162327 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:33.162610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] PATH_INFO: `/v3/projects/52d93d53f87d4cd880caffdb9ff34023` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:33.164598 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d93d53f87d4cd880caffdb9ff34023)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:33.166670 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:33.308685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:33.325090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d93d53f87d4cd880caffdb9ff34023', 'request_id': 'req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.330710 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d93d53f87d4cd880caffdb9ff34023', 'request_id': 'req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.403788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d93d53f87d4cd880caffdb9ff34023', 'request_id': 'req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.417221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] The token cache is being invalidate because project 52d93d53f87d4cd880caffdb9ff34023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:33.417515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.418166 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.419717 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1363/2696] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:33 2022] DELETE /identity/v3/projects/52d93d53f87d4cd880caffdb9ff34023 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:33.423772 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:33.434350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875248d4-72ce-480f-be64-c364cec11be3 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:33.493872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:33.494788 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:33.495070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:33.495343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] PATH_INFO: `/v3/users/5b9b1965f6754157999428329f6b7139` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:33.496482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9b1965f6754157999428329f6b7139)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:33.498383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:33.695041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9b1965f6754157999428329f6b7139'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.707656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9b1965f6754157999428329f6b7139'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.708377 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9b1965f6754157999428329f6b7139'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.775842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9b1965f6754157999428329f6b7139'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.777113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-0f253c01-2a1d-42a8-a883-3ae124a2d4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9b1965f6754157999428329f6b7139'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:33.791937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1334/2697] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:33 2022] DELETE /identity/v3/users/5b9b1965f6754157999428329f6b7139 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:31:34.252858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:34.254534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:34.268815 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e7826-d1c7-4e18-a889-e1cbb47eb144 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:34.347118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:34.347762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:34.348104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:34.348384 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] PATH_INFO: `/v3/projects/cb5e6dfdb2094727b6378aecb6336082` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:34.349536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5e6dfdb2094727b6378aecb6336082)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:34.351475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:34.468068 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5e6dfdb2094727b6378aecb6336082', 'request_id': 'req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:34.474536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5e6dfdb2094727b6378aecb6336082', 'request_id': 'req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:34.549784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5e6dfdb2094727b6378aecb6336082', 'request_id': 'req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:34.562934 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] The token cache is being invalidate because project cb5e6dfdb2094727b6378aecb6336082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:34.563228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:34.563896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d31af2f3-eb61-4315-b3e5-62a7a7c6328a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:34.565426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1364/2698] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:34 2022] DELETE /identity/v3/projects/cb5e6dfdb2094727b6378aecb6336082 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:34.570218 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fb7b6-e7f9-4ddc-9629-4d1b351e02ac None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:34.570721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fb7b6-e7f9-4ddc-9629-4d1b351e02ac None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:34.570864 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fb7b6-e7f9-4ddc-9629-4d1b351e02ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:34.591649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7e2fb7b6-e7f9-4ddc-9629-4d1b351e02ac None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:34.592856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7e2fb7b6-e7f9-4ddc-9629-4d1b351e02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:34.654819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1335/2699] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:34.662905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867bad-a0ef-4959-b3b5-1a1aae98603a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:34.663198 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867bad-a0ef-4959-b3b5-1a1aae98603a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:34.663481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867bad-a0ef-4959-b3b5-1a1aae98603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:34.685757 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dd867bad-a0ef-4959-b3b5-1a1aae98603a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:34.687027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dd867bad-a0ef-4959-b3b5-1a1aae98603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:34.699905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1365/2700] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:34.710886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fb7b6-e7f9-4ddc-9629-4d1b351e02ac None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:34.710886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:34.715700 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fb7b6-e7f9-4ddc-9629-4d1b351e02ac None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:34.720670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:34.721282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:34.721563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:34.721840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:34.722521 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:31:34.722899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:34.724744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:34.737433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1336/2701] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:31:34.742834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867bad-a0ef-4959-b3b5-1a1aae98603a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:34.755889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867bad-a0ef-4959-b3b5-1a1aae98603a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:34.763981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:34.764859 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:34.765220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:34.765644 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:34.767060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:34.769970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:34.892546 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1366/2702] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:34.893741 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:34.904661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f5f0-a580-4a3b-99ee-3d23e105ff32 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:34.965665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:34.966395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:34.966782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:34.967137 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:34.967901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:34.969976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:35.053522 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1337/2703] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:31:34 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:35.058373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:35.069452 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285eebc-fc5b-4e14-b266-210d8f72e67b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:35.074985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:35.075594 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:35.075891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:35.076140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:35.076783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:35.078391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:35.089461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1367/2704] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:35.094702 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:35.106195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e77dd-7ae8-453d-b631-a0700f3ae83b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:35.111883 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f977650-6e02-42e6-9d51-9d58bc463929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:35.112548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f977650-6e02-42e6-9d51-9d58bc463929 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:35.112927 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f977650-6e02-42e6-9d51-9d58bc463929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:35.113210 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f977650-6e02-42e6-9d51-9d58bc463929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:35.114097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f977650-6e02-42e6-9d51-9d58bc463929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:35.116000 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f977650-6e02-42e6-9d51-9d58bc463929 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:35.135367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1338/2705] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:35.137624 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:35.144711 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:35.153501 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e53b-2b77-4a50-a4ee-3d00e54d0065 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:35.158574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:35.159296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:35.159591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:35.159831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] PATH_INFO: `/v3/projects/ac8091c750f949febb518d0fcf9f70e2/users/431f8ed26add4980ae17be823b63e30d/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:35.176491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8091c750f949febb518d0fcf9f70e2, user_id=431f8ed26add4980ae17be823b63e30d, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:35.179491 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:35.296775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1368/2706] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:35 2022] PUT /identity/v3/projects/ac8091c750f949febb518d0fcf9f70e2/users/431f8ed26add4980ae17be823b63e30d/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:35.301972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7da372-08e7-45fb-b27b-e50781359f91 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:35.302258 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7da372-08e7-45fb-b27b-e50781359f91 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:35.302537 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7da372-08e7-45fb-b27b-e50781359f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:35.325900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-3f7da372-08e7-45fb-b27b-e50781359f91 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:35.327174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-3f7da372-08e7-45fb-b27b-e50781359f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:35.401671 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1339/2707] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:35.412544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:35.417807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:35.481872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441fb6f-8000-4a62-9c02-945911c6889d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:35.485851 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:35.486656 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:35.487719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:35.487719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:35.503009 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:35.505169 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:35.521919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1369/2708] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:37.083245 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb55ba3-43d8-46e5-88a7-ecb5f197bae4 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:37.083793 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb55ba3-43d8-46e5-88a7-ecb5f197bae4 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:37.084009 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb55ba3-43d8-46e5-88a7-ecb5f197bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:37.117274 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7bb55ba3-43d8-46e5-88a7-ecb5f197bae4 None None] MFA Rules not processed for user `431f8ed26add4980ae17be823b63e30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:37.118408 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7bb55ba3-43d8-46e5-88a7-ecb5f197bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:37.187789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:37.193242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1340/2709] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:37.205420 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:37.206951 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:37.277760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22339486-16f6-489e-9e00-77a8e08db8a2 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:37.281722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:37.282389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:37.282697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:37.283072 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:37.295065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:37.296574 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:37.307559 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1370/2710] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:39.332028 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:39.332598 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:39.332699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:39.353024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] MFA Rules not processed for user `431f8ed26add4980ae17be823b63e30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:39.354252 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:39.361568 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1341/2711] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:45.423154 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:45.437368 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6277-2fc2-488b-a8e3-a1e6b86f42dc service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:45.442303 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c789-44da-44f4-8451-2170136c13aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:45.443132 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c789-44da-44f4-8451-2170136c13aa service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:45.443459 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c789-44da-44f4-8451-2170136c13aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:45.443744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c789-44da-44f4-8451-2170136c13aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:45.446055 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-43b8c789-44da-44f4-8451-2170136c13aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:45.464479 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c789-44da-44f4-8451-2170136c13aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:45.467972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c789-44da-44f4-8451-2170136c13aa service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:45.479866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1371/2712] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:49.348004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:55.475772 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:57.900531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:57.905289 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:57.985266 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042056d-4006-4c4d-b6ae-7ce03d265ac9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:57.991704 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:57.992420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.992713 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.992992 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.995328 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:58.010019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:58.011792 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:58.028878 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1342/2713] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:59.162969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:59.168742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:59.168742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:59.184419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] MFA Rules not processed for user `431f8ed26add4980ae17be823b63e30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:59.186580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:59.193753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1372/2714] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:31:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:59.888155 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:59.890519 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:59.971669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39ccb-c7f0-47f4-8544-fa1c4073c5bf service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:59.979502 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f364b3-5d68-4442-9cf5-a0c62f855848 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:59.980354 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f364b3-5d68-4442-9cf5-a0c62f855848 service placement] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:59.980669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f364b3-5d68-4442-9cf5-a0c62f855848 service placement] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:59.981080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f364b3-5d68-4442-9cf5-a0c62f855848 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:59.983896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e8f364b3-5d68-4442-9cf5-a0c62f855848 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:59.997594 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f364b3-5d68-4442-9cf5-a0c62f855848 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:59.999870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f364b3-5d68-4442-9cf5-a0c62f855848 service placement] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:00.010994 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1343/2715] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:09.178792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:10.006078 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=66 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:11.302124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.303736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:11.321379 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2145c4-21ca-4be8-a27b-385b95ccea35 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.327257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.327676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.328167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.328476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.330296 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:11.344403 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.346066 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.357890 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1373/2716] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:21.352886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:25.872044 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f85ee-6d2b-494e-8506-40fb926c1654 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:25.872639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f85ee-6d2b-494e-8506-40fb926c1654 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:25.872639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f85ee-6d2b-494e-8506-40fb926c1654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:25.932622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-639f85ee-6d2b-494e-8506-40fb926c1654 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:25.933886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-639f85ee-6d2b-494e-8506-40fb926c1654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:26.041127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1344/2717] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 17 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:26.209326 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:26.210834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:26.345731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646db02-d5de-4446-ba1b-e50de99843b3 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:26.351422 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef606d85-d212-4995-9f16-1855d5f2de57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:26.352051 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef606d85-d212-4995-9f16-1855d5f2de57 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:26.352335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef606d85-d212-4995-9f16-1855d5f2de57 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:26.352609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef606d85-d212-4995-9f16-1855d5f2de57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:26.363135 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef606d85-d212-4995-9f16-1855d5f2de57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:26.368962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef606d85-d212-4995-9f16-1855d5f2de57 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:26.375747 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1374/2718] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:32:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:32:36.035153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=40 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:36.370733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=41 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:42.074219 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497d73f-0501-4272-a60f-2860bda06357 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.075286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497d73f-0501-4272-a60f-2860bda06357 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.075640 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497d73f-0501-4272-a60f-2860bda06357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.099474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-5497d73f-0501-4272-a60f-2860bda06357 None None] MFA Rules not processed for user `d3375fbaa62241cf83dd214b21d742b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:42.101330 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-5497d73f-0501-4272-a60f-2860bda06357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:42.180803 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1345/2719] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:44.563828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:44.572290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:44.572290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:44.584942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] MFA Rules not processed for user `31e687163dec4063a3932d164b06654e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:44.586194 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:44.594472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1375/2720] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 17 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:44.610938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497d73f-0501-4272-a60f-2860bda06357 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:44.629791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497d73f-0501-4272-a60f-2860bda06357 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:44.638806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0c376af51e4b5195da5ff453026ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:44.639514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:44.639819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:44.640195 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:44.655504 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:44.658619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:44.674002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1346/2721] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 17 20:32:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 20:32:48.030277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:48.031773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:48.048458 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259709ce-71e4-401a-86e6-5431d28c5d14 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:48.054437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:48.055337 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:48.055778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:48.056059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:48.058013 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:48.071560 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:48.073163 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:48.096583 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1376/2722] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:48.205575 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:48.218819 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e58733-9c0c-4c56-9f2c-f596c1419c1e service swift] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:48.223916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:48.224692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:48.225183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:48.225532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] PATH_INFO: `/v3/users/431f8ed26add4980ae17be823b63e30d` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:48.226872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431f8ed26add4980ae17be823b63e30d)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:48.228920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:48.529262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431f8ed26add4980ae17be823b63e30d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.554123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431f8ed26add4980ae17be823b63e30d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.554123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431f8ed26add4980ae17be823b63e30d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.634104 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431f8ed26add4980ae17be823b63e30d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.634846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-97426564-2efe-4e04-9bca-88e3685de2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431f8ed26add4980ae17be823b63e30d'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.661599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1347/2723] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:48 2022] DELETE /identity/v3/users/431f8ed26add4980ae17be823b63e30d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:49.373792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:49.387335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6baa5e-c13b-4809-9e2d-2505f7cca237 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:49.460203 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:49.462186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.462186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.462186 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] PATH_INFO: `/v3/projects/ac8091c750f949febb518d0fcf9f70e2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.463204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8091c750f949febb518d0fcf9f70e2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:49.465310 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:49.833846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8091c750f949febb518d0fcf9f70e2', 'request_id': 'req-a996fc68-6838-4858-bb2c-c5be329a07cb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:49.840567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8091c750f949febb518d0fcf9f70e2', 'request_id': 'req-a996fc68-6838-4858-bb2c-c5be329a07cb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:49.982726 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8091c750f949febb518d0fcf9f70e2', 'request_id': 'req-a996fc68-6838-4858-bb2c-c5be329a07cb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:50.020608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] The token cache is being invalidate because project ac8091c750f949febb518d0fcf9f70e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:50.022093 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:50.023812 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:50.029867 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1377/2724] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:49 2022] DELETE /identity/v3/projects/ac8091c750f949febb518d0fcf9f70e2 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:51.471647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:51.472133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:51.472242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:51.492161 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] MFA Rules not processed for user `79b37b77e3e44797b58ef9dd89747ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:51.493635 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:51.556608 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1348/2725] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:32:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:51.902962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:51.904527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:51.964231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996fc68-6838-4858-bb2c-c5be329a07cb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:51.968272 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:51.968869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:51.969151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:51.969426 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:51.971178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:51.980771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:51.982175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:51.991162 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1378/2726] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:00.213484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.215129 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:00.228285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:00.306880 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401ee22-866f-4955-b845-00cd3aed9f76 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.313164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.313791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.314072 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.314349 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.316367 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:00.331982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.333910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.353529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1349/2727] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:01.987699 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:10.432111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=30 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:54.616060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:54.629415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230adca-67d4-412f-84d5-54ebd962ae0a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:54.634931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:54.635673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:54.635928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:54.636220 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:54.637957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:54.711715 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:54.713554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:54.724856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1379/2728] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:34:01.042679 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:01.052498 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22394f-f6c8-4cde-b0c2-d121a30a9056 service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:01.056261 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:01.056928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:01.057213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:01.057486 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:01.059283 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:01.123444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:01.125023 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:01.134945 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1350/2729] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:34:04.481229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:04.482773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:04.557240 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a198d-3f1a-406f-8dac-044aff7832f9 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:04.563248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:04.563927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:04.564212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:04.564495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:04.566215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:04.577946 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:04.579581 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:04.589580 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1380/2730] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:34:04.643783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:04.645337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:04.658143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3e36-7728-4ae3-89fa-1479ff2875b0 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:04.662933 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:04.663495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:04.663777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:04.664052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] PATH_INFO: `/v3/users/d3375fbaa62241cf83dd214b21d742b8` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:04.665206 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3375fbaa62241cf83dd214b21d742b8)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:04.667163 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:04.863494 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3375fbaa62241cf83dd214b21d742b8'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:04.877127 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3375fbaa62241cf83dd214b21d742b8'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:04.877781 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3375fbaa62241cf83dd214b21d742b8'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:04.957812 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3375fbaa62241cf83dd214b21d742b8'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:04.958414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-f3a60272-8e2f-4041-bf81-208a0a0a4cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3375fbaa62241cf83dd214b21d742b8'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:04.972175 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1351/2731] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:34:04 2022] DELETE /identity/v3/users/d3375fbaa62241cf83dd214b21d742b8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:05.265939 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:05.277448 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa582553-0dc6-4160-a11b-8ec8cf039f85 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:05.336816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:05.337454 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:05.337734 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:05.338012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] PATH_INFO: `/v3/projects/ce3c6f9ea3764773a663c1a67b1c5ae6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:05.340095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3c6f9ea3764773a663c1a67b1c5ae6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:05.342003 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:05.550964 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:05.564323 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'request_id': 'req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:05.569609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'request_id': 'req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:05.638239 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'request_id': 'req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:05.650168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] The token cache is being invalidate because project ce3c6f9ea3764773a663c1a67b1c5ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:34:05.650464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:05.651129 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-33f8a3da-f36d-44c2-a6a8-b3ce9cf22b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:05.652727 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1381/2732] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:34:05 2022] DELETE /identity/v3/projects/ce3c6f9ea3764773a663c1a67b1c5ae6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:05.658238 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2965-8ad7-49aa-b853-c53ba50a4cad None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:05.658774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2965-8ad7-49aa-b853-c53ba50a4cad None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:05.658874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2965-8ad7-49aa-b853-c53ba50a4cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:05.679385 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d60e2965-8ad7-49aa-b853-c53ba50a4cad None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:05.683872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d60e2965-8ad7-49aa-b853-c53ba50a4cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:05.744153 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1352/2733] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:05.752892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbffb8f-7536-49c7-9f7f-210f8100b42d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:05.753183 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbffb8f-7536-49c7-9f7f-210f8100b42d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:05.753465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbffb8f-7536-49c7-9f7f-210f8100b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:05.774197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3bbffb8f-7536-49c7-9f7f-210f8100b42d None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:05.775455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3bbffb8f-7536-49c7-9f7f-210f8100b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:05.784796 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1382/2734] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:05.788916 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2965-8ad7-49aa-b853-c53ba50a4cad None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:05.799886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2965-8ad7-49aa-b853-c53ba50a4cad None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:05.804642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:05.805256 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:05.805534 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:05.805806 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:05.806451 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:34:05.806790 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:05.808644 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:05.810299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:05.827207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1353/2735] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:34:05.830513 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbffb8f-7536-49c7-9f7f-210f8100b42d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:05.840858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbffb8f-7536-49c7-9f7f-210f8100b42d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:05.846313 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:05.846881 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:05.847210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:05.847444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:05.848060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:05.849999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:05.936760 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1383/2736] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:34:05 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:05.941024 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:05.951105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc00e1c-2fd8-4e0e-b167-d21b1483521a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.013250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.013868 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.014150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.014428 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.015102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.021605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:06.135572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1354/2737] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:34:05 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:06.140500 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:06.151059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf61c7-4de3-4d0f-8ea0-f17453eaff39 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.157170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.157788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.158069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.158341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.159029 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.160620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:06.171819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1384/2738] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:06.175879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:06.186412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb350ec-3239-4826-b024-719a586253a0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.191183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620c8d3-f8c1-48bc-b504-8f724ce75684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.191777 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620c8d3-f8c1-48bc-b504-8f724ce75684 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.192055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620c8d3-f8c1-48bc-b504-8f724ce75684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.192361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620c8d3-f8c1-48bc-b504-8f724ce75684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.192996 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620c8d3-f8c1-48bc-b504-8f724ce75684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.194586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620c8d3-f8c1-48bc-b504-8f724ce75684 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:06.206742 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1355/2739] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:06.210971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:06.222724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa5c5-cc38-4e85-bfef-340bbdc3ce99 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.227302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.227942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.228219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.228493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] PATH_INFO: `/v3/projects/6363857fab6544cf84b89ebf6e3874ef/users/56badfe2abd344b49b3c481d6379b0ee/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.244190 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6363857fab6544cf84b89ebf6e3874ef, user_id=56badfe2abd344b49b3c481d6379b0ee, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.247111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:06.325059 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1385/2740] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:34:06 2022] PUT /identity/v3/projects/6363857fab6544cf84b89ebf6e3874ef/users/56badfe2abd344b49b3c481d6379b0ee/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:06.335440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c818f-134f-44f9-9a26-df655180f1fa None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.335839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c818f-134f-44f9-9a26-df655180f1fa None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.336142 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c818f-134f-44f9-9a26-df655180f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.365420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f34c818f-134f-44f9-9a26-df655180f1fa None None] MFA Rules not processed for user `56badfe2abd344b49b3c481d6379b0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:06.367007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f34c818f-134f-44f9-9a26-df655180f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:06.436455 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1356/2741] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:06.440953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:06.505082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a847a-d2b8-408e-b8c9-51b43ac9852b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.510210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.510894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.511887 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.512215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.512844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.514811 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:06.643700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1386/2742] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:34:06 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:06.647895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c818f-134f-44f9-9a26-df655180f1fa None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:06.658490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c818f-134f-44f9-9a26-df655180f1fa None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.717204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.717744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.718026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.718302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.718975 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.720890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:06.730002 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:06.882131 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1357/2743] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:34:06 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:06.886360 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:06.897285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d63dd-6e28-4440-b49d-959f8e2766bf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.903412 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.904065 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.904353 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.904634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.905374 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.907018 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:06.918608 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1387/2744] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:06.923643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:06.934533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127c7f-7e28-4f90-a44d-f610784601e5 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:06.939107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:06.939754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:06.940031 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:06.940301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] PATH_INFO: `/v3/projects/4efca59676144059806fdebb3d8f5cb0/users/6715ea5d5c954ac28a00ad7c95565e09/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:06.955748 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efca59676144059806fdebb3d8f5cb0, user_id=6715ea5d5c954ac28a00ad7c95565e09, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:06.958380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:07.043187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1358/2745] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:34:06 2022] PUT /identity/v3/projects/4efca59676144059806fdebb3d8f5cb0/users/6715ea5d5c954ac28a00ad7c95565e09/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:07.047997 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:07.059389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67469c36-c158-42d2-9d54-bd68766c2b7f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:07.086579 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:07.121138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461963bd-db1e-47c0-82cb-569b2b2156b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:07.122822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461963bd-db1e-47c0-82cb-569b2b2156b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:07.122822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461963bd-db1e-47c0-82cb-569b2b2156b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:07.122822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461963bd-db1e-47c0-82cb-569b2b2156b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:07.123139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461963bd-db1e-47c0-82cb-569b2b2156b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:07.124679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461963bd-db1e-47c0-82cb-569b2b2156b5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:07.134835 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1388/2746] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:07.139499 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:07.150341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887418c5-6684-40ba-a0a4-e2ae3d86ac00 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:07.156089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:07.156906 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:07.157064 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:07.157348 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] PATH_INFO: `/v3/projects/4efca59676144059806fdebb3d8f5cb0/users/6715ea5d5c954ac28a00ad7c95565e09/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:07.159327 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efca59676144059806fdebb3d8f5cb0, user_id=6715ea5d5c954ac28a00ad7c95565e09, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:07.174682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:07.174682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1359/2747] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:34:07 2022] PUT /identity/v3/projects/4efca59676144059806fdebb3d8f5cb0/users/6715ea5d5c954ac28a00ad7c95565e09/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:07.186784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:07.187080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:07.187390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:07.217988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] MFA Rules not processed for user `6715ea5d5c954ac28a00ad7c95565e09`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:07.219257 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:07.294404 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1389/2748] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:07.305371 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:07.307105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:07.366360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2891cc7-4119-424b-823f-c26c66757ddc admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:07.370128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:07.370892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:07.371200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:07.371618 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:07.430116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:07.431675 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:07.440914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1360/2749] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:34:13.982973 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:13.984588 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:13.997820 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708bbcb-d789-4e76-a9b9-4b0f81280787 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:14.001437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b83429-fdbb-4c29-b321-d70d5e575144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:14.002067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b83429-fdbb-4c29-b321-d70d5e575144 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:14.002354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b83429-fdbb-4c29-b321-d70d5e575144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:14.004025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b83429-fdbb-4c29-b321-d70d5e575144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:14.012476 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b83429-fdbb-4c29-b321-d70d5e575144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:14.013993 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b83429-fdbb-4c29-b321-d70d5e575144 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:14.023686 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1390/2750] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:34:17.436903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:INSERT=4,keystone:SELECT=65 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:24.019477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=56 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:41.737839 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:41.802823 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f27f6-9248-4e42-bf40-271b8ca6c972 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:41.807574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:41.808200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:41.808480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:41.808754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] PATH_INFO: `/v3/users/56badfe2abd344b49b3c481d6379b0ee` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:41.809866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56badfe2abd344b49b3c481d6379b0ee)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:41.811847 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:42.027526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56badfe2abd344b49b3c481d6379b0ee'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.039709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56badfe2abd344b49b3c481d6379b0ee'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.040366 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56badfe2abd344b49b3c481d6379b0ee'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.115646 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56badfe2abd344b49b3c481d6379b0ee'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.116393 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56badfe2abd344b49b3c481d6379b0ee'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.130719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1361/2751] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:34:41 2022] DELETE /identity/v3/users/56badfe2abd344b49b3c481d6379b0ee => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:42.135224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:42.135839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:42.135839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:42.155263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:42.156480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:42.217265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1391/2752] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:42.227183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:42.228703 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:42.288067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433ca6-5396-4fb4-ba2b-5363b2a3cf0a admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:42.292532 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:42.293228 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:42.293546 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:42.293871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:42.303490 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:42.304936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:42.315148 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1362/2753] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:34:42.752179 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:42.752525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:42.769766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84d16d-dfc5-41c2-a202-086155675a8a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:42.774509 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:42.775178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:42.775486 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:42.775739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] PATH_INFO: `/v3/projects/6363857fab6544cf84b89ebf6e3874ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:42.776894 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6363857fab6544cf84b89ebf6e3874ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:42.778837 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:42.892612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6363857fab6544cf84b89ebf6e3874ef', 'request_id': 'req-9a53d389-668b-4a84-b2b3-f4d216eea560'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.898226 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6363857fab6544cf84b89ebf6e3874ef', 'request_id': 'req-9a53d389-668b-4a84-b2b3-f4d216eea560'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.980218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6363857fab6544cf84b89ebf6e3874ef', 'request_id': 'req-9a53d389-668b-4a84-b2b3-f4d216eea560'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.993027 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] The token cache is being invalidate because project 6363857fab6544cf84b89ebf6e3874ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:34:42.993369 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.994019 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:42.995589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1392/2754] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:34:42 2022] DELETE /identity/v3/projects/6363857fab6544cf84b89ebf6e3874ef => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:42.999953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:43.009884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51321-d23d-4480-8807-0bfc6818e077 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:43.034990 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:43.075658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:43.076897 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:43.077133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:43.077400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] PATH_INFO: `/v3/users/6715ea5d5c954ac28a00ad7c95565e09` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:43.078533 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6715ea5d5c954ac28a00ad7c95565e09)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:43.080480 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:43.284027 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6715ea5d5c954ac28a00ad7c95565e09'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:43.296370 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6715ea5d5c954ac28a00ad7c95565e09'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:43.297081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6715ea5d5c954ac28a00ad7c95565e09'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:43.371976 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6715ea5d5c954ac28a00ad7c95565e09'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:43.372789 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-85cde441-ac65-448d-a997-e2510da79b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6715ea5d5c954ac28a00ad7c95565e09'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:43.386791 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1363/2755] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:34:42 2022] DELETE /identity/v3/users/6715ea5d5c954ac28a00ad7c95565e09 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:44.159270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:44.160832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:44.176679 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d389-668b-4a84-b2b3-f4d216eea560 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:44.236777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:44.237405 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:44.237683 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:44.237957 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] PATH_INFO: `/v3/projects/4efca59676144059806fdebb3d8f5cb0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:44.239109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efca59676144059806fdebb3d8f5cb0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:44.241248 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:44.359827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:44.377515 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efca59676144059806fdebb3d8f5cb0', 'request_id': 'req-202201df-c2a6-4780-9277-84f3b1dafde4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:44.383302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efca59676144059806fdebb3d8f5cb0', 'request_id': 'req-202201df-c2a6-4780-9277-84f3b1dafde4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:44.555279 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efca59676144059806fdebb3d8f5cb0', 'request_id': 'req-202201df-c2a6-4780-9277-84f3b1dafde4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:44.567060 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] The token cache is being invalidate because project 4efca59676144059806fdebb3d8f5cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:34:44.567347 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:44.567986 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-202201df-c2a6-4780-9277-84f3b1dafde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:44.569474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1393/2756] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:34:44 2022] DELETE /identity/v3/projects/4efca59676144059806fdebb3d8f5cb0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:44.574337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63131c-070c-4640-807d-ee3d81c0d3e9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:44.574865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63131c-070c-4640-807d-ee3d81c0d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:44.574977 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63131c-070c-4640-807d-ee3d81c0d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:44.595732 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2c63131c-070c-4640-807d-ee3d81c0d3e9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:44.596935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2c63131c-070c-4640-807d-ee3d81c0d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:44.659026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1364/2757] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:44.667095 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7f0f-9836-4450-96dd-db195d982903 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:44.667389 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7f0f-9836-4450-96dd-db195d982903 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:44.667673 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7f0f-9836-4450-96dd-db195d982903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:44.687782 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-902d7f0f-9836-4450-96dd-db195d982903 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:44.688999 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-902d7f0f-9836-4450-96dd-db195d982903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:44.697182 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1394/2758] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:44.702030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63131c-070c-4640-807d-ee3d81c0d3e9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:44.711709 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63131c-070c-4640-807d-ee3d81c0d3e9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:44.716433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:44.717662 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:44.717948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:44.718226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:44.718919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:34:44.719226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:44.720831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:44.734154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1365/2759] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:34:44.738712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d7f0f-9836-4450-96dd-db195d982903 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:44.748787 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d7f0f-9836-4450-96dd-db195d982903 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:44.753665 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:44.754274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:44.754557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:44.754955 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:44.755571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:44.757720 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:44.856410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1395/2760] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:34:44 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:44.860886 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:44.871563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22fa57-e318-46b8-bb58-a2dcae8e3522 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:44.899657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:44.932060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:44.932755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:44.933101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:44.933426 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:44.934123 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:44.936417 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.043677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1366/2761] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:34:44 2022] POST /identity/v3/users => generated 305 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:45.048041 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.059521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0f89a-73e1-45de-92fc-ff35ebdd3db6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.065039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.065719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.066023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.066304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.066987 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.068590 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.080293 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1396/2762] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:45.084375 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.095528 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee8f6-bacf-4825-9fff-4ecce76f8b29 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.100199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80551745-12c2-45ba-ac5b-65f1fb9e059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.100797 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551745-12c2-45ba-ac5b-65f1fb9e059b admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.101081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551745-12c2-45ba-ac5b-65f1fb9e059b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.101360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551745-12c2-45ba-ac5b-65f1fb9e059b admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.102001 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80551745-12c2-45ba-ac5b-65f1fb9e059b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.103626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80551745-12c2-45ba-ac5b-65f1fb9e059b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.113826 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1367/2763] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:45.118325 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.128911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbcdf0-37b2-40d2-955d-e873ba1fd019 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.133723 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.134375 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.134677 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.134959 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] PATH_INFO: `/v3/projects/a0b6a50a277e410294703d052629d728/users/26c6dc0e9ee44a399b46e4ad8bafe4ae/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.150225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b6a50a277e410294703d052629d728, user_id=26c6dc0e9ee44a399b46e4ad8bafe4ae, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.152966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.232868 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1397/2764] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:34:45 2022] PUT /identity/v3/projects/a0b6a50a277e410294703d052629d728/users/26c6dc0e9ee44a399b46e4ad8bafe4ae/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:45.245292 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100eaef-923e-484e-8065-e70b67a345f5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.245626 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100eaef-923e-484e-8065-e70b67a345f5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.245907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100eaef-923e-484e-8065-e70b67a345f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.281091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-7100eaef-923e-484e-8065-e70b67a345f5 None None] MFA Rules not processed for user `26c6dc0e9ee44a399b46e4ad8bafe4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:45.282345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7100eaef-923e-484e-8065-e70b67a345f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:45.348111 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1368/2765] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:45 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:45.352869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.439791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f087a4-0d11-4d30-885f-651f22ed9050 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.444477 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.445173 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.445461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.445742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.446417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.448436 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.540172 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1398/2766] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:34:45 2022] POST /identity/v3/projects => generated 409 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:45.544315 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100eaef-923e-484e-8065-e70b67a345f5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.556260 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100eaef-923e-484e-8065-e70b67a345f5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.615693 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.616445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.616599 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.616894 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.617514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.619487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.729285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1369/2767] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:34:45 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:45.734253 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.745111 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be389ae0-274a-4618-90ac-d14e7313e1dc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.749941 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.750540 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.750850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.751129 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.751773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.753367 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.764690 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1399/2768] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:45.769090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.780007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1839c5-6812-41cb-a172-2b6f3ac495e1 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.784690 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.785344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.785630 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.785912 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] PATH_INFO: `/v3/projects/6719d2d1dcee44f98720591abd6123d2/users/39287a55735e4ab2b14190a729dea4cc/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.802243 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6719d2d1dcee44f98720591abd6123d2, user_id=39287a55735e4ab2b14190a729dea4cc, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.804935 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.883168 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1370/2769] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:34:45 2022] PUT /identity/v3/projects/6719d2d1dcee44f98720591abd6123d2/users/39287a55735e4ab2b14190a729dea4cc/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:45.887304 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.897620 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43897a25-9fd1-49b1-b10a-6670678b286e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.917907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:45.954754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e21610-6c92-4bb2-b854-598fc4a14128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.955419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21610-6c92-4bb2-b854-598fc4a14128 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.955705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21610-6c92-4bb2-b854-598fc4a14128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.955981 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21610-6c92-4bb2-b854-598fc4a14128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.956621 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e21610-6c92-4bb2-b854-598fc4a14128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.958241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e21610-6c92-4bb2-b854-598fc4a14128 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:45.969246 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1400/2770] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:45.973074 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:45.978493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:45.984901 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add62de-e6e4-43b3-b1fd-b6abb22bd596 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:45.989419 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:45.990164 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:45.990737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:45.991011 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] PATH_INFO: `/v3/projects/6719d2d1dcee44f98720591abd6123d2/users/39287a55735e4ab2b14190a729dea4cc/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:45.992914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6719d2d1dcee44f98720591abd6123d2, user_id=39287a55735e4ab2b14190a729dea4cc, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:45.995657 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:46.006337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1371/2771] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:34:45 2022] PUT /identity/v3/projects/6719d2d1dcee44f98720591abd6123d2/users/39287a55735e4ab2b14190a729dea4cc/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:46.017039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a33c-4596-4d08-85e8-d43809bd9fea None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:46.017332 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a33c-4596-4d08-85e8-d43809bd9fea None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:46.017619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a33c-4596-4d08-85e8-d43809bd9fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:46.046512 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7453a33c-4596-4d08-85e8-d43809bd9fea None None] MFA Rules not processed for user `39287a55735e4ab2b14190a729dea4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:46.047797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7453a33c-4596-4d08-85e8-d43809bd9fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:46.118437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1401/2772] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:46 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:46.129928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:46.132004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:46.195531 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fa2c3-1b2b-4ce6-89a5-52779d07aae0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:46.199232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:46.199843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:46.200236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:46.200395 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:46.210705 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:46.212199 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:46.222619 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1372/2773] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:46 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:34:46.613529 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a33c-4596-4d08-85e8-d43809bd9fea None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:46.624141 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a33c-4596-4d08-85e8-d43809bd9fea None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:46.627740 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2a396-cb96-42f7-9fec-18a6a293a726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:46.628363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2a396-cb96-42f7-9fec-18a6a293a726 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:46.628646 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2a396-cb96-42f7-9fec-18a6a293a726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:46.628926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2a396-cb96-42f7-9fec-18a6a293a726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:46.689316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2a396-cb96-42f7-9fec-18a6a293a726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:46.690793 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2a396-cb96-42f7-9fec-18a6a293a726 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:46.700023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1402/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:46 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:34:56.218070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:56.695883 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=80 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:56.898430 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:56.961937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d5ef6-e8f5-4d8a-838b-277a621035d5 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:56.967121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:56.967672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:56.967958 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:56.968271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] PATH_INFO: `/v3/users/26c6dc0e9ee44a399b46e4ad8bafe4ae` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:56.969410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c6dc0e9ee44a399b46e4ad8bafe4ae)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:56.971382 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:57.175162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c6dc0e9ee44a399b46e4ad8bafe4ae'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:57.187423 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c6dc0e9ee44a399b46e4ad8bafe4ae'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:57.188136 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c6dc0e9ee44a399b46e4ad8bafe4ae'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:57.320655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c6dc0e9ee44a399b46e4ad8bafe4ae'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:57.321416 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c6dc0e9ee44a399b46e4ad8bafe4ae'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:57.335322 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1373/2775] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:34:56 2022] DELETE /identity/v3/users/26c6dc0e9ee44a399b46e4ad8bafe4ae => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:57.339925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:57.340212 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:57.340493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:57.360966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:57.362227 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:57.422614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1403/2776] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:57.432838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:57.434277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:57.492461 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268d687-3a21-43d9-9875-1032dbcc39ff admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:57.495960 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:57.496557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:57.496836 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:57.497107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:57.506325 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:57.507787 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:57.517998 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1374/2777] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:34:57.936585 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:57.938131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:57.955228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d93bd9-13c7-4f2a-a46e-2a0f470367d8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:57.956681 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:57.957320 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:57.957599 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:57.957869 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] PATH_INFO: `/v3/projects/a0b6a50a277e410294703d052629d728` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:57.959012 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b6a50a277e410294703d052629d728)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:57.960907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:58.141144 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b6a50a277e410294703d052629d728', 'request_id': 'req-fadc3bf2-0829-43ff-9981-67faae1c7143'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.146827 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b6a50a277e410294703d052629d728', 'request_id': 'req-fadc3bf2-0829-43ff-9981-67faae1c7143'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.241151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b6a50a277e410294703d052629d728', 'request_id': 'req-fadc3bf2-0829-43ff-9981-67faae1c7143'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.253557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] The token cache is being invalidate because project a0b6a50a277e410294703d052629d728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:34:58.256840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.256840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.256840 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1404/2778] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:34:57 2022] DELETE /identity/v3/projects/a0b6a50a277e410294703d052629d728 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:34:58.260303 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:58.271493 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190905d7-4158-4d08-b4d3-97b1f336f9b7 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:58.293284 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:58.333102 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:58.333829 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:58.334007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:58.334285 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] PATH_INFO: `/v3/users/39287a55735e4ab2b14190a729dea4cc` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:58.335444 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39287a55735e4ab2b14190a729dea4cc)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:58.337389 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:58.564919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39287a55735e4ab2b14190a729dea4cc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.577648 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39287a55735e4ab2b14190a729dea4cc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.578443 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39287a55735e4ab2b14190a729dea4cc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.665467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39287a55735e4ab2b14190a729dea4cc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.666121 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-600dbb04-8e78-4fbb-880b-9e70ead51361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39287a55735e4ab2b14190a729dea4cc'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:58.681282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1375/2779] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:34:58 2022] DELETE /identity/v3/users/39287a55735e4ab2b14190a729dea4cc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:59.148100 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:59.149761 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:59.164818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3bf2-0829-43ff-9981-67faae1c7143 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:59.223785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:59.224415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.224695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.224969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] PATH_INFO: `/v3/projects/6719d2d1dcee44f98720591abd6123d2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.226090 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6719d2d1dcee44f98720591abd6123d2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:59.228071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:59.316647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:59.333388 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6719d2d1dcee44f98720591abd6123d2', 'request_id': 'req-83bb189c-651f-4661-96f0-8a8d1bf18b8b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:59.338855 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6719d2d1dcee44f98720591abd6123d2', 'request_id': 'req-83bb189c-651f-4661-96f0-8a8d1bf18b8b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:59.406496 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6719d2d1dcee44f98720591abd6123d2', 'request_id': 'req-83bb189c-651f-4661-96f0-8a8d1bf18b8b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:59.418724 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] The token cache is being invalidate because project 6719d2d1dcee44f98720591abd6123d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:34:59.419418 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:59.420138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83bb189c-651f-4661-96f0-8a8d1bf18b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:34:59.421674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1405/2780] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:34:59 2022] DELETE /identity/v3/projects/6719d2d1dcee44f98720591abd6123d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:34:59.426642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb3ce9-b2b8-4d5c-93fe-1a526600c047 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.427172 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb3ce9-b2b8-4d5c-93fe-1a526600c047 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.427401 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb3ce9-b2b8-4d5c-93fe-1a526600c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.447691 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-e4bb3ce9-b2b8-4d5c-93fe-1a526600c047 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:59.448902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-e4bb3ce9-b2b8-4d5c-93fe-1a526600c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:59.509277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1376/2781] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:59.518442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d18dbc-1bb0-4d1f-aa03-ec0be8877fba None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.518853 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d18dbc-1bb0-4d1f-aa03-ec0be8877fba None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.519139 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d18dbc-1bb0-4d1f-aa03-ec0be8877fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.538742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a3d18dbc-1bb0-4d1f-aa03-ec0be8877fba None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:34:59.539956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a3d18dbc-1bb0-4d1f-aa03-ec0be8877fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:34:59.547838 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1406/2782] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:34:59.552151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb3ce9-b2b8-4d5c-93fe-1a526600c047 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:59.562398 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb3ce9-b2b8-4d5c-93fe-1a526600c047 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:59.567033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:59.567816 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.568133 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.568386 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.569033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:34:59.569343 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:59.570973 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:59.583699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1377/2783] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:34:59.587947 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d18dbc-1bb0-4d1f-aa03-ec0be8877fba None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:59.597263 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d18dbc-1bb0-4d1f-aa03-ec0be8877fba None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:59.601854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:59.602444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.602754 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.603031 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.603649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:59.605536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:59.710612 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1407/2784] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:34:59 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:59.715070 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:59.725345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895827ce-8fc6-47a6-8a60-aff03d16988f admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:59.753119 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:59.785979 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:59.786590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.786910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.787188 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.787842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:59.789802 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:59.920962 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1378/2785] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:34:59 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:34:59.925443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:59.936736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866edb-ed54-4d1f-8a9a-f81b317df460 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:59.941223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:59.941907 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.942210 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.942453 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.943127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:59.944704 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:59.955647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1408/2786] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:59.959665 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:34:59.970597 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2007046-f63e-4225-acc0-41c5ad50b3b4 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:34:59.975214 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95a90-df33-4399-bcda-167249003813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:34:59.975805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95a90-df33-4399-bcda-167249003813 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:34:59.976086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95a90-df33-4399-bcda-167249003813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:34:59.976364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95a90-df33-4399-bcda-167249003813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:34:59.977003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b95a90-df33-4399-bcda-167249003813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:34:59.978672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b95a90-df33-4399-bcda-167249003813 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:34:59.992524 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1379/2787] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:34:59.993872 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:00.004719 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a60a09-e41c-43f3-994f-7ca75f441407 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:00.009393 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:00.010050 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.010342 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.010736 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] PATH_INFO: `/v3/projects/35d2527b791043e5ac02abb17d28e7f3/users/59659c3fd5c043619afb649a91dce31c/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.026270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d2527b791043e5ac02abb17d28e7f3, user_id=59659c3fd5c043619afb649a91dce31c, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:00.029398 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:00.109722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1409/2788] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:34:59 2022] PUT /identity/v3/projects/35d2527b791043e5ac02abb17d28e7f3/users/59659c3fd5c043619afb649a91dce31c/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:00.176753 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e1eb-6f0a-4745-8289-d23fd44258a5 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.177043 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e1eb-6f0a-4745-8289-d23fd44258a5 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.177321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e1eb-6f0a-4745-8289-d23fd44258a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.207154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-93a4e1eb-6f0a-4745-8289-d23fd44258a5 None None] MFA Rules not processed for user `59659c3fd5c043619afb649a91dce31c`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:00.208276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-93a4e1eb-6f0a-4745-8289-d23fd44258a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:00.276442 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1380/2789] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:00.281351 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:00.345302 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158a1d-b616-475d-965a-c43135d00574 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:00.349977 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:00.350586 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.350906 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.351185 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.351823 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:00.353767 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:00.453700 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1410/2790] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:35:00 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:00.457733 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4e1eb-6f0a-4745-8289-d23fd44258a5 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:00.468862 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4e1eb-6f0a-4745-8289-d23fd44258a5 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:00.526254 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:00.526890 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.527174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.527447 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.528067 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:00.530213 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:00.641341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1381/2791] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:35:00 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:00.645233 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:00.655784 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fff2f0-6927-4a03-9ee0-29dd820805a0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:00.660548 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:00.661148 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.661435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.661708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.662461 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:00.664049 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:00.676116 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1411/2792] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:00.680128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:00.691440 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec6e5-30e6-4334-ab79-1d9bbe93ca0e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:00.696183 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e8494-b29f-457b-a77c-8b5e421ca76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:00.696809 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8494-b29f-457b-a77c-8b5e421ca76f admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.697089 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8494-b29f-457b-a77c-8b5e421ca76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.697365 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8494-b29f-457b-a77c-8b5e421ca76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.698003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e8494-b29f-457b-a77c-8b5e421ca76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:00.699661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e8494-b29f-457b-a77c-8b5e421ca76f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:00.709908 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1382/2793] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:00.714014 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:00.724526 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeeb7d-8d3f-4d25-86f6-5a35cea4c75b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:00.729197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:00.729841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.730125 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.730406 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] PATH_INFO: `/v3/projects/42d7e26081e843c5bdce8d84d3a673a6/users/c4e63eaebc134acf88e900c7f0860fd7/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.745115 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d7e26081e843c5bdce8d84d3a673a6, user_id=c4e63eaebc134acf88e900c7f0860fd7, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:00.748527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:00.827691 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:00.832472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1412/2794] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:00 2022] PUT /identity/v3/projects/42d7e26081e843c5bdce8d84d3a673a6/users/c4e63eaebc134acf88e900c7f0860fd7/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:00.842674 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1559-bf98-45b5-9633-1f4b1616b42e None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:00.842969 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1559-bf98-45b5-9633-1f4b1616b42e None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:00.843250 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1559-bf98-45b5-9633-1f4b1616b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:00.871005 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-50eb1559-bf98-45b5-9633-1f4b1616b42e None None] MFA Rules not processed for user `c4e63eaebc134acf88e900c7f0860fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:00.873106 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-50eb1559-bf98-45b5-9633-1f4b1616b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:00.877383 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:00.938590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1383/2795] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:35:00.943206 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.006618 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddabe-f43e-460e-b118-8b88f5402ad3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.011328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.011930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.012213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.012493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.013722 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:01.015742 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:01.100976 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1413/2796] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:35:00 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:01.105196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1559-bf98-45b5-9633-1f4b1616b42e None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.116909 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1559-bf98-45b5-9633-1f4b1616b42e None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.175076 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.175701 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.175997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.176299 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.176911 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:01.178891 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:01.277294 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1384/2797] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:35:01 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:01.281413 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.292931 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaccac-9dc2-461f-899f-60c66a4e246b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.298652 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.299281 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.299568 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.299849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.300494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:01.302101 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:01.313606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1414/2798] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:01.317813 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.328346 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca145-8093-4b3e-b0bb-9cf09a8b8bed admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.332987 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.333642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.333925 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.334203 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] PATH_INFO: `/v3/projects/2d529040f6804ba2b74907d5121b5828/users/e3c6956561144088814e6bfb8da9f124/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.349351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d529040f6804ba2b74907d5121b5828, user_id=e3c6956561144088814e6bfb8da9f124, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:01.352134 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:01.476570 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1385/2799] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:01 2022] PUT /identity/v3/projects/2d529040f6804ba2b74907d5121b5828/users/e3c6956561144088814e6bfb8da9f124/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:01.480647 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.492266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765cca-00d3-45f2-9e63-0af5d0b11d79 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.549769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52366c9-356d-49d9-aa04-b07a9c3df7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.550301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52366c9-356d-49d9-aa04-b07a9c3df7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.550584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52366c9-356d-49d9-aa04-b07a9c3df7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.550896 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52366c9-356d-49d9-aa04-b07a9c3df7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.551549 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52366c9-356d-49d9-aa04-b07a9c3df7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:01.553178 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52366c9-356d-49d9-aa04-b07a9c3df7f8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:01.563208 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1415/2800] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:01.567615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.578464 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83626-d8c0-43a3-9bc1-de1af4ca699f admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.583132 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.583782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.584063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.584338 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] PATH_INFO: `/v3/projects/2d529040f6804ba2b74907d5121b5828/users/e3c6956561144088814e6bfb8da9f124/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.586291 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d529040f6804ba2b74907d5121b5828, user_id=e3c6956561144088814e6bfb8da9f124, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:01.589003 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:01.600032 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1386/2801] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:01 2022] PUT /identity/v3/projects/2d529040f6804ba2b74907d5121b5828/users/e3c6956561144088814e6bfb8da9f124/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:01.611170 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.611464 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.611775 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.639666 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] MFA Rules not processed for user `e3c6956561144088814e6bfb8da9f124`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:01.640882 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:01.703619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:01.712394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1416/2802] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:01.723586 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.725467 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:01.785507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7fa3b-8e3a-4383-bfac-e97b974fab20 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.789280 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.789892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.790176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.790507 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:01.800037 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:01.801412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:01.806445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:01.811981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1387/2803] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:01.930307 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:01.931745 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:01.944481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ca236-4dd1-4b11-ab43-2972803628b3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:01.948052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158a4d1-cede-4aa5-9e05-ae013e0cbf9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:01.948659 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158a4d1-cede-4aa5-9e05-ae013e0cbf9e service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:01.948943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158a4d1-cede-4aa5-9e05-ae013e0cbf9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:01.949221 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158a4d1-cede-4aa5-9e05-ae013e0cbf9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:02.008806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158a4d1-cede-4aa5-9e05-ae013e0cbf9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:02.010265 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158a4d1-cede-4aa5-9e05-ae013e0cbf9e service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:02.019816 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1417/2804] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:06.223731 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:06.288510 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba57202-b667-4ee3-9be2-b6111cd37170 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:06.293222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:06.294767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:06.295130 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:06.295484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] PATH_INFO: `/v3/users/59659c3fd5c043619afb649a91dce31c` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:06.296637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59659c3fd5c043619afb649a91dce31c)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:06.298609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:06.557241 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59659c3fd5c043619afb649a91dce31c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:06.569143 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59659c3fd5c043619afb649a91dce31c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:06.569850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59659c3fd5c043619afb649a91dce31c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:06.636489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59659c3fd5c043619afb649a91dce31c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:06.637160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59659c3fd5c043619afb649a91dce31c'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:06.650314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1388/2805] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:35:06 2022] DELETE /identity/v3/users/59659c3fd5c043619afb649a91dce31c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:06.655507 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:06.655988 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:06.656177 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:06.675982 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:06.677245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:06.736807 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1418/2806] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:06.747433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:06.748966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:06.808940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ae7f-3074-4934-9f41-b0c7b30321a0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:06.813364 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:06.813550 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:06.813982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:06.814265 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:06.814572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:06.814908 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:06.826539 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:06.827122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:06.836818 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1389/2807] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:06.876584 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d6ea2-b1d0-4dad-879a-3d3f8017d4bd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:06.880155 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:06.880762 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:06.881039 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:06.881316 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:06.883067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:06.934929 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:06.947676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:06.949109 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:06.958849 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1419/2808] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:35:07.302158 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:07.304485 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:07.324484 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b0a6-9ee4-4e00-845f-4ba48555ca9a service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:07.331189 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:07.332128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:07.332472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:07.332830 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] PATH_INFO: `/v3/projects/35d2527b791043e5ac02abb17d28e7f3` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:07.334167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d2527b791043e5ac02abb17d28e7f3)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:07.336204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:07.362495 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:07.515151 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d2527b791043e5ac02abb17d28e7f3', 'request_id': 'req-016db9d5-bf58-44f8-bf5f-658c242a3ce0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:07.521400 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d2527b791043e5ac02abb17d28e7f3', 'request_id': 'req-016db9d5-bf58-44f8-bf5f-658c242a3ce0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:07.625547 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d2527b791043e5ac02abb17d28e7f3', 'request_id': 'req-016db9d5-bf58-44f8-bf5f-658c242a3ce0'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:07.638187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] The token cache is being invalidate because project 35d2527b791043e5ac02abb17d28e7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:35:07.638603 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:07.639316 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:07.643463 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1390/2809] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:35:07 2022] DELETE /identity/v3/projects/35d2527b791043e5ac02abb17d28e7f3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:07.645209 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:07.656225 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994da5-5d66-47c7-afcd-86fa0fc87b32 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:07.717444 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:07.718075 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:07.718354 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:07.718718 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] PATH_INFO: `/v3/users/c4e63eaebc134acf88e900c7f0860fd7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:07.719818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e63eaebc134acf88e900c7f0860fd7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:07.721819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:07.988038 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e63eaebc134acf88e900c7f0860fd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.001341 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e63eaebc134acf88e900c7f0860fd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.008061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e63eaebc134acf88e900c7f0860fd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.008756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e63eaebc134acf88e900c7f0860fd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.115098 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e63eaebc134acf88e900c7f0860fd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.121653 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1420/2810] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:35:07 2022] DELETE /identity/v3/users/c4e63eaebc134acf88e900c7f0860fd7 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:08.564482 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:08.565920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:08.587833 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016db9d5-bf58-44f8-bf5f-658c242a3ce0 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:08.647874 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:08.648509 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:08.648794 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:08.649073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] PATH_INFO: `/v3/projects/42d7e26081e843c5bdce8d84d3a673a6` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:08.650190 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d7e26081e843c5bdce8d84d3a673a6)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:08.652314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:08.756914 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d7e26081e843c5bdce8d84d3a673a6', 'request_id': 'req-269fd572-01fb-470a-91a8-034ef1e2bb66'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.762271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d7e26081e843c5bdce8d84d3a673a6', 'request_id': 'req-269fd572-01fb-470a-91a8-034ef1e2bb66'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.836277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d7e26081e843c5bdce8d84d3a673a6', 'request_id': 'req-269fd572-01fb-470a-91a8-034ef1e2bb66'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.848928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] The token cache is being invalidate because project 42d7e26081e843c5bdce8d84d3a673a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:35:08.853920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.853920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:08.853920 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1391/2811] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:35:08 2022] DELETE /identity/v3/projects/42d7e26081e843c5bdce8d84d3a673a6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:08.855431 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:08.857274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:08.870292 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a253cb-b372-40a2-b6d9-c6752d22e75d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:08.928228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:08.928888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:08.929174 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:08.929453 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] PATH_INFO: `/v3/users/e3c6956561144088814e6bfb8da9f124` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:08.930600 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c6956561144088814e6bfb8da9f124)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:08.932558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:08.942695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:09.136346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c6956561144088814e6bfb8da9f124'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:09.148942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c6956561144088814e6bfb8da9f124'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:09.156161 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c6956561144088814e6bfb8da9f124'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:09.156864 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c6956561144088814e6bfb8da9f124'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:09.274706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-553f3adf-5e93-4c44-91d2-599ac833f7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c6956561144088814e6bfb8da9f124'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:09.281306 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1421/2812] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:35:08 2022] DELETE /identity/v3/users/e3c6956561144088814e6bfb8da9f124 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:09.710832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:09.712276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:09.725857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fd572-01fb-470a-91a8-034ef1e2bb66 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:09.762326 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:09.786846 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:09.787475 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:09.787754 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:09.788026 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] PATH_INFO: `/v3/projects/2d529040f6804ba2b74907d5121b5828` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:09.789124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d529040f6804ba2b74907d5121b5828)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:09.791055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:09.926687 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d529040f6804ba2b74907d5121b5828', 'request_id': 'req-a283f270-7ca2-4ae3-90e6-5ba3984a5283'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:09.932207 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d529040f6804ba2b74907d5121b5828', 'request_id': 'req-a283f270-7ca2-4ae3-90e6-5ba3984a5283'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:10.040333 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d529040f6804ba2b74907d5121b5828', 'request_id': 'req-a283f270-7ca2-4ae3-90e6-5ba3984a5283'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:10.052647 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] The token cache is being invalidate because project 2d529040f6804ba2b74907d5121b5828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:35:10.052931 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:10.053560 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-a283f270-7ca2-4ae3-90e6-5ba3984a5283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:10.055055 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1392/2813] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:35:09 2022] DELETE /identity/v3/projects/2d529040f6804ba2b74907d5121b5828 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:10.062034 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bbfa4-3195-4f16-9543-1ca4a43df584 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.062531 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bbfa4-3195-4f16-9543-1ca4a43df584 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.062655 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bbfa4-3195-4f16-9543-1ca4a43df584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.083085 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-587bbfa4-3195-4f16-9543-1ca4a43df584 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:10.086213 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-587bbfa4-3195-4f16-9543-1ca4a43df584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:10.145709 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1422/2814] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:10.154659 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416215e-c495-4ae0-9370-cef8a4ca9ab2 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.154948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416215e-c495-4ae0-9370-cef8a4ca9ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.155276 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416215e-c495-4ae0-9370-cef8a4ca9ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.175736 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-a416215e-c495-4ae0-9370-cef8a4ca9ab2 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:10.176963 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a416215e-c495-4ae0-9370-cef8a4ca9ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:10.185740 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1393/2815] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:10.190295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bbfa4-3195-4f16-9543-1ca4a43df584 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.199945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bbfa4-3195-4f16-9543-1ca4a43df584 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:10.205071 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:10.205674 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.205963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.206236 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.206905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:35:10.207214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:10.208919 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:10.220748 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1423/2816] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:35:10.225197 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416215e-c495-4ae0-9370-cef8a4ca9ab2 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.235497 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416215e-c495-4ae0-9370-cef8a4ca9ab2 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:10.240445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:10.241062 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.241331 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.241611 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.242239 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:10.244177 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:10.333476 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1394/2817] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:35:10 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:10.341151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.351467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38e02-7049-4975-872d-4a8277971298 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:10.410390 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:10.411032 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.411328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.411610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.412242 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:10.414241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:10.500558 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1424/2818] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:35:10 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:10.504842 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.515361 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db1ee-186f-49b0-bbe4-2d96e9a4103f admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:10.519956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:10.520551 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.520832 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.521105 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.521744 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:10.523380 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:10.534474 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1395/2819] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:35:10.538295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.545692 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:10.549648 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8cf52-03ae-4747-8dfe-287385bd6bae admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:10.554468 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd34e-efdf-47ef-b760-cdfa14934061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:10.558237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd34e-efdf-47ef-b760-cdfa14934061 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.558237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd34e-efdf-47ef-b760-cdfa14934061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.558237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd34e-efdf-47ef-b760-cdfa14934061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.558237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd34e-efdf-47ef-b760-cdfa14934061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:10.558237 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd34e-efdf-47ef-b760-cdfa14934061 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:10.568804 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1425/2820] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:35:10.573101 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.583609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0709d05-4520-4f75-a76b-823ccb74dd19 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:10.588310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:10.589034 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.589248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.589525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] PATH_INFO: `/v3/projects/2efc462261ac43f09ff572c037939ed0/users/834ccd23db4a4649a6b0f042944e80f2/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.608059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efc462261ac43f09ff572c037939ed0, user_id=834ccd23db4a4649a6b0f042944e80f2, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:10.610724 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:10.683235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1396/2821] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:10 2022] PUT /identity/v3/projects/2efc462261ac43f09ff572c037939ed0/users/834ccd23db4a4649a6b0f042944e80f2/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:10.694660 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85931a06-3325-43ff-b162-627eb69859a1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.694966 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85931a06-3325-43ff-b162-627eb69859a1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.695271 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85931a06-3325-43ff-b162-627eb69859a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.724309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-85931a06-3325-43ff-b162-627eb69859a1 None None] MFA Rules not processed for user `834ccd23db4a4649a6b0f042944e80f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:10.725571 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-85931a06-3325-43ff-b162-627eb69859a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:10.795176 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1426/2822] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:10.800345 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.863899 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564272-f7c5-43e4-8d5a-7ea2112131a8 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:10.869050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:10.869656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:10.869942 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:10.870221 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:10.870875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:10.872937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:10.878489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:10.978999 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1397/2823] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:35:10 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:35:10.983231 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85931a06-3325-43ff-b162-627eb69859a1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:10.994350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85931a06-3325-43ff-b162-627eb69859a1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:11.052352 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:11.052963 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:11.053245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:11.053525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:11.054153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:11.056104 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:11.162447 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1427/2824] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:35:10 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:35:11.166379 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:11.177746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149f36d-e281-49af-9c2b-74f86ca458fd admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:11.182466 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:11.183107 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:11.183394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:11.183672 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:11.185240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:11.186875 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:11.196938 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1398/2825] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:11.201437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:11.211785 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cabd0-13d9-4407-a593-50a758d04768 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:11.217282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:11.217928 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:11.218215 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:11.218497 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] PATH_INFO: `/v3/projects/f531751749c64185b5af9716e7ac7a3b/users/7bb94138fdba4ea08fe4dab85fecc16f/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:11.234328 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f531751749c64185b5af9716e7ac7a3b, user_id=7bb94138fdba4ea08fe4dab85fecc16f, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:11.237046 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:11.320729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1428/2826] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:11 2022] PUT /identity/v3/projects/f531751749c64185b5af9716e7ac7a3b/users/7bb94138fdba4ea08fe4dab85fecc16f/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:11.324783 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:11.334796 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2e10-95a1-467a-9fbd-8dd8757a210b admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:11.393500 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cadf38-b5f0-4fc6-9ee8-a34be3737af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:11.394116 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cadf38-b5f0-4fc6-9ee8-a34be3737af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:11.394431 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cadf38-b5f0-4fc6-9ee8-a34be3737af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:11.394747 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cadf38-b5f0-4fc6-9ee8-a34be3737af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:11.395399 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cadf38-b5f0-4fc6-9ee8-a34be3737af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:11.397019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cadf38-b5f0-4fc6-9ee8-a34be3737af3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:11.407617 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1399/2827] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:11.411914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:11.422930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59cb27-75c5-4018-aaa1-ee8048506dea admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:11.427575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:11.429446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:11.429446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:11.429446 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] PATH_INFO: `/v3/projects/f531751749c64185b5af9716e7ac7a3b/users/7bb94138fdba4ea08fe4dab85fecc16f/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:11.430873 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f531751749c64185b5af9716e7ac7a3b, user_id=7bb94138fdba4ea08fe4dab85fecc16f, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:11.433521 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:11.443879 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1429/2828] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:11 2022] PUT /identity/v3/projects/f531751749c64185b5af9716e7ac7a3b/users/7bb94138fdba4ea08fe4dab85fecc16f/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:11.455374 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de7ae-a241-4a7d-b253-8a7c80955640 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:11.455667 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de7ae-a241-4a7d-b253-8a7c80955640 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:11.455947 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de7ae-a241-4a7d-b253-8a7c80955640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:11.485903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-811de7ae-a241-4a7d-b253-8a7c80955640 None None] MFA Rules not processed for user `7bb94138fdba4ea08fe4dab85fecc16f`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:11.487166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-811de7ae-a241-4a7d-b253-8a7c80955640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:11.557483 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1400/2829] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:11.568753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:11.570462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:11.611241 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:11.629001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7996-abfb-4db7-b09b-e30e9a32dcc0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:11.632752 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35611e4c-5681-4541-8d6b-394f00b6203e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:11.633467 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611e4c-5681-4541-8d6b-394f00b6203e service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:11.633749 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611e4c-5681-4541-8d6b-394f00b6203e service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:11.634023 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611e4c-5681-4541-8d6b-394f00b6203e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:11.648994 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35611e4c-5681-4541-8d6b-394f00b6203e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:11.650505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35611e4c-5681-4541-8d6b-394f00b6203e service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:11.661634 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1430/2830] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:13.135902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811de7ae-a241-4a7d-b253-8a7c80955640 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:13.195923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:13.200445 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811de7ae-a241-4a7d-b253-8a7c80955640 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:13.205166 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:13.205798 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:13.206082 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:13.206403 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] PATH_INFO: `/v3/users/834ccd23db4a4649a6b0f042944e80f2` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:13.207755 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=834ccd23db4a4649a6b0f042944e80f2)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:13.209707 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:13.497746 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834ccd23db4a4649a6b0f042944e80f2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:13.510452 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834ccd23db4a4649a6b0f042944e80f2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:13.511201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834ccd23db4a4649a6b0f042944e80f2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:13.629041 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834ccd23db4a4649a6b0f042944e80f2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:13.629652 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834ccd23db4a4649a6b0f042944e80f2'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:13.643035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1401/2831] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:35:13 2022] DELETE /identity/v3/users/834ccd23db4a4649a6b0f042944e80f2 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:13.647643 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:13.648168 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:13.648274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:13.669377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:13.670865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:13.731841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1431/2832] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:13.741972 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:13.743590 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:13.803650 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9b378-9645-4fd0-b4f2-7fd25e03c9fb admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:13.807222 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:13.807877 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:13.808160 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:13.808458 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:13.818951 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:13.820420 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:13.832341 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1402/2833] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:14.317563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:14.319103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:14.332555 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe42a-3c87-4c67-8925-4319b5847ab8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:14.337943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:14.338614 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:14.339064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:14.339343 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] PATH_INFO: `/v3/projects/2efc462261ac43f09ff572c037939ed0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:14.340544 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efc462261ac43f09ff572c037939ed0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:14.342589 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:14.491534 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efc462261ac43f09ff572c037939ed0', 'request_id': 'req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:14.499610 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efc462261ac43f09ff572c037939ed0', 'request_id': 'req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:14.653759 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efc462261ac43f09ff572c037939ed0', 'request_id': 'req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:14.667557 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] The token cache is being invalidate because project 2efc462261ac43f09ff572c037939ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:35:14.667962 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:14.669371 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:14.670971 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1432/2834] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:35:14 2022] DELETE /identity/v3/projects/2efc462261ac43f09ff572c037939ed0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:35:14.675287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:14.690113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3fdd-6d14-4107-94be-77a94f4f2120 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:14.754297 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:14.754981 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:14.755264 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:14.755543 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] PATH_INFO: `/v3/users/7bb94138fdba4ea08fe4dab85fecc16f` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:14.756688 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb94138fdba4ea08fe4dab85fecc16f)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:14.758642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:14.784557 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:14.982312 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb94138fdba4ea08fe4dab85fecc16f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:14.995362 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb94138fdba4ea08fe4dab85fecc16f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:14.996061 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb94138fdba4ea08fe4dab85fecc16f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:15.059033 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb94138fdba4ea08fe4dab85fecc16f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:15.059919 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-9fd8f44d-d1b5-43ef-8fb9-f8d4d080ae18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb94138fdba4ea08fe4dab85fecc16f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:15.081902 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1403/2835] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:35:14 2022] DELETE /identity/v3/users/7bb94138fdba4ea08fe4dab85fecc16f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:15.521731 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:15.523199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:15.538856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d74b1-24ba-49d7-8217-5dc3a2176ad0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:15.601010 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:15.601649 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:15.601926 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:15.602199 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] PATH_INFO: `/v3/projects/f531751749c64185b5af9716e7ac7a3b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:15.603355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f531751749c64185b5af9716e7ac7a3b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:15.605286 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:15.607911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:15.772739 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f531751749c64185b5af9716e7ac7a3b', 'request_id': 'req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:15.778301 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f531751749c64185b5af9716e7ac7a3b', 'request_id': 'req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:16.008839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f531751749c64185b5af9716e7ac7a3b', 'request_id': 'req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:16.021419 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] The token cache is being invalidate because project f531751749c64185b5af9716e7ac7a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:35:16.021706 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:16.022346 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a8cf02fa-0008-4d14-8c6c-6b78fed385f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:16.023899 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1433/2836] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:35:15 2022] DELETE /identity/v3/projects/f531751749c64185b5af9716e7ac7a3b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:16.028954 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35974b2-b1e9-48c5-bf01-c97217986828 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.029472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35974b2-b1e9-48c5-bf01-c97217986828 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.029574 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35974b2-b1e9-48c5-bf01-c97217986828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.048870 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f35974b2-b1e9-48c5-bf01-c97217986828 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:16.050073 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f35974b2-b1e9-48c5-bf01-c97217986828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:16.120388 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1404/2837] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:16.128846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7665-34f6-4dcc-903c-d82278bcbd3f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.129134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7665-34f6-4dcc-903c-d82278bcbd3f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.129409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7665-34f6-4dcc-903c-d82278bcbd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.149601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1e8d7665-34f6-4dcc-903c-d82278bcbd3f None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:16.150844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1e8d7665-34f6-4dcc-903c-d82278bcbd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:16.158967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1434/2838] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:16.167767 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35974b2-b1e9-48c5-bf01-c97217986828 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:16.178907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35974b2-b1e9-48c5-bf01-c97217986828 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:16.183712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:16.184948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.185227 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.185503 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] PATH_INFO: `/v3/domains` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.186269 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:35:16.186563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:16.188209 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:16.201765 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1405/2839] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:35:16.213705 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7665-34f6-4dcc-903c-d82278bcbd3f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:16.223401 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7665-34f6-4dcc-903c-d82278bcbd3f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:16.228415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:16.228865 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.229147 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.229494 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.230121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:16.232788 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:16.354080 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1435/2840] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:35:16 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:16.359270 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:16.369737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c82c3-c561-4627-b99f-28594f86d635 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:16.429282 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:16.429910 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.430178 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.430462 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.431201 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:16.433310 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:16.583668 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1406/2841] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:35:16 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:16.587409 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:16.598611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c4146-0cc2-44af-9823-c45f8dfb0764 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:16.603228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:16.603822 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.604153 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.604370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.605089 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:16.607770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:16.618088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1436/2842] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:16.622281 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:16.632394 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb80e6-8f78-4dc4-8b52-233be2c2576e admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:16.636928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c4d0-78f4-438a-b516-7501b2175b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:16.637573 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c4d0-78f4-438a-b516-7501b2175b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.637851 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c4d0-78f4-438a-b516-7501b2175b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.638162 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c4d0-78f4-438a-b516-7501b2175b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.638859 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c4d0-78f4-438a-b516-7501b2175b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:16.640425 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c4d0-78f4-438a-b516-7501b2175b11 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:16.651601 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1407/2843] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:16.656309 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:16.666376 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2623f0-44d5-4734-ba1e-2fb6a1f951b8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:16.672245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39adc-1e3d-43f0-93d3-7b4371bf185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:16.672925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39adc-1e3d-43f0-93d3-7b4371bf185c admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.673205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39adc-1e3d-43f0-93d3-7b4371bf185c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.673483 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39adc-1e3d-43f0-93d3-7b4371bf185c admin admin] PATH_INFO: `/v3/projects/87b332e62f9d4603ae443f3fd2e8f0fb/users/b6213b45db1e4680ae7fb8105119ee74/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.689472 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39adc-1e3d-43f0-93d3-7b4371bf185c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b332e62f9d4603ae443f3fd2e8f0fb, user_id=b6213b45db1e4680ae7fb8105119ee74, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:16.692197 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39adc-1e3d-43f0-93d3-7b4371bf185c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:16.766353 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.766661 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.773719 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.775182 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:16.787059 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] MFA Rules not processed for user `79b37b77e3e44797b58ef9dd89747ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:16.788314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:16.806361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1437/2844] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:16 2022] PUT /identity/v3/projects/87b332e62f9d4603ae443f3fd2e8f0fb/users/b6213b45db1e4680ae7fb8105119ee74/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:16.814290 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dac8-bc8b-47d4-803c-d564ec757124 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:16.814576 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dac8-bc8b-47d4-803c-d564ec757124 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:16.814871 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dac8-bc8b-47d4-803c-d564ec757124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:16.834909 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8858dac8-bc8b-47d4-803c-d564ec757124 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:16.836136 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8858dac8-bc8b-47d4-803c-d564ec757124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:16.854609 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1408/2845] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:35:16.900435 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1438/2846] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:35:16.912174 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:16.913591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:16.972895 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9a4d-46b4-4bce-b78f-cd6c4b313e34 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:17.026235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a64ecc-f938-4520-80c0-dd2b0f59cfcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:17.026879 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a64ecc-f938-4520-80c0-dd2b0f59cfcd service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:17.027154 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a64ecc-f938-4520-80c0-dd2b0f59cfcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:17.027435 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a64ecc-f938-4520-80c0-dd2b0f59cfcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:17.037413 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a64ecc-f938-4520-80c0-dd2b0f59cfcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:17.038923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a64ecc-f938-4520-80c0-dd2b0f59cfcd service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:17.049821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1409/2847] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:17.199216 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858dac8-bc8b-47d4-803c-d564ec757124 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:17.209725 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858dac8-bc8b-47d4-803c-d564ec757124 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:17.214958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:17.214958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:17.214958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:17.214958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:17.218061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:17.228407 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:17.229856 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:17.239143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1439/2848] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:18.630550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf4379-8f6d-49b4-9354-928ad7225228 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:18.631030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf4379-8f6d-49b4-9354-928ad7225228 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:18.631277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf4379-8f6d-49b4-9354-928ad7225228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:18.662090 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-f0bf4379-8f6d-49b4-9354-928ad7225228 None None] MFA Rules not processed for user `b6213b45db1e4680ae7fb8105119ee74`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:18.663411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-f0bf4379-8f6d-49b4-9354-928ad7225228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:18.729811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=100 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:18.736259 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1410/2849] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:18.740771 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:18.753443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c1b33-0db5-456e-a7b8-b1cdf8a0700e service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:18.758270 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:18.758925 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:18.759204 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:18.759481 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:18.760114 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:18.762001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:18.777493 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:18.923565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1440/2850] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:35:18 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:18.927729 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf4379-8f6d-49b4-9354-928ad7225228 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:18.938843 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf4379-8f6d-49b4-9354-928ad7225228 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:18.995682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:18.996216 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:18.996505 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:18.996782 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] PATH_INFO: `/v3/users` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:18.997593 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:18.999576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:19.134135 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1411/2851] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:35:18 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:35:19.139024 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:19.149539 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f328ce-4fc0-4a55-a697-0c1fea52486d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:19.154975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:19.155575 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:19.155858 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:19.156134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:19.156778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:19.158364 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:19.168443 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1441/2852] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:19.175548 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:19.185966 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598b1dc-1cb9-4938-a3e2-63cab9b2c000 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:19.190834 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:19.191492 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:19.191774 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:19.192052 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] PATH_INFO: `/v3/projects/e5b4a62037cc44699512a260885663da/users/93bf44bba277481886b77a7beea70745/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:19.208126 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b4a62037cc44699512a260885663da, user_id=93bf44bba277481886b77a7beea70745, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:19.210848 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:19.298952 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1412/2853] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:19 2022] PUT /identity/v3/projects/e5b4a62037cc44699512a260885663da/users/93bf44bba277481886b77a7beea70745/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:19.305783 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:19.328218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9561dc-dcde-4bdb-aa20-f322a393d4a3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:19.388770 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:19.389474 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:19.389657 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:19.389942 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:19.390607 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:19.392245 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:19.403462 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1442/2854] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:19.410866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:19.422542 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc7f8-ad1d-4204-9f09-fff518f5ad89 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:19.427811 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85a764-7d4d-49ea-850c-1a0c3ebd27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:19.428840 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a764-7d4d-49ea-850c-1a0c3ebd27c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:19.429314 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a764-7d4d-49ea-850c-1a0c3ebd27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:19.429677 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a764-7d4d-49ea-850c-1a0c3ebd27c2 admin admin] PATH_INFO: `/v3/projects/e5b4a62037cc44699512a260885663da/users/93bf44bba277481886b77a7beea70745/roles/0dae4c7453cb4002973f39bc52b35d8e` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:19.431821 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85a764-7d4d-49ea-850c-1a0c3ebd27c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b4a62037cc44699512a260885663da, user_id=93bf44bba277481886b77a7beea70745, role_id=0dae4c7453cb4002973f39bc52b35d8e)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:19.435176 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85a764-7d4d-49ea-850c-1a0c3ebd27c2 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:19.448329 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1413/2855] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:19 2022] PUT /identity/v3/projects/e5b4a62037cc44699512a260885663da/users/93bf44bba277481886b77a7beea70745/roles/0dae4c7453cb4002973f39bc52b35d8e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:19.706596 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:19.708377 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:19.783914 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151939-1ba7-417f-b7f7-5e9610318c49 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:19.850606 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:19.851247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:19.851523 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:19.851794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:19.853530 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:19.866073 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:19.867695 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:19.878445 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1443/2856] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:20.981204 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98124e30-4a4c-471b-8ca2-284c5127716b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:20.982049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98124e30-4a4c-471b-8ca2-284c5127716b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:20.982049 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98124e30-4a4c-471b-8ca2-284c5127716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:21.022433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-98124e30-4a4c-471b-8ca2-284c5127716b None None] MFA Rules not processed for user `93bf44bba277481886b77a7beea70745`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:21.023721 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-98124e30-4a4c-471b-8ca2-284c5127716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:21.096955 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1414/2857] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:21.109025 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:21.110505 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:21.124611 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:21.170658 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3fba8-5425-4d70-a062-e620f70aa741 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:21.174903 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:21.175514 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:21.175794 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:21.176082 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:21.235956 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:21.237391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:21.249201 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1444/2858] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:23.573236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98124e30-4a4c-471b-8ca2-284c5127716b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:23.584065 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98124e30-4a4c-471b-8ca2-284c5127716b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:23.587699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:23.588302 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:23.588579 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:23.588849 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:23.599277 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:23.600907 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:23.611766 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1415/2859] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:31.304969 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=43 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:33.607305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:40.208211 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:40.276020 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0640b1-0f1a-40ae-af91-21ec98536496 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:40.280841 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:40.281480 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:40.281763 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:40.282040 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] PATH_INFO: `/v3/users/b6213b45db1e4680ae7fb8105119ee74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:40.283223 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6213b45db1e4680ae7fb8105119ee74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:40.285192 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:40.534329 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6213b45db1e4680ae7fb8105119ee74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:40.546832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6213b45db1e4680ae7fb8105119ee74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:40.553911 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6213b45db1e4680ae7fb8105119ee74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:40.554601 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6213b45db1e4680ae7fb8105119ee74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:40.628525 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6213b45db1e4680ae7fb8105119ee74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:40.635370 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1445/2860] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:35:40 2022] DELETE /identity/v3/users/b6213b45db1e4680ae7fb8105119ee74 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:40.877591 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:40.890087 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7b385-603d-46fb-99d1-9a7be32da5c2 service cinder] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:40.951373 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:40.952013 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:40.952323 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:40.952743 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] PATH_INFO: `/v3/projects/87b332e62f9d4603ae443f3fd2e8f0fb` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:40.953903 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b332e62f9d4603ae443f3fd2e8f0fb)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:40.955936 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:41.107552 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b332e62f9d4603ae443f3fd2e8f0fb', 'request_id': 'req-220dfd5f-2ac9-4b19-ae22-8c7491424539'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.113077 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b332e62f9d4603ae443f3fd2e8f0fb', 'request_id': 'req-220dfd5f-2ac9-4b19-ae22-8c7491424539'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.202696 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b332e62f9d4603ae443f3fd2e8f0fb', 'request_id': 'req-220dfd5f-2ac9-4b19-ae22-8c7491424539'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.214865 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] The token cache is being invalidate because project 87b332e62f9d4603ae443f3fd2e8f0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:35:41.215187 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.216489 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.217997 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1416/2861] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:35:40 2022] DELETE /identity/v3/projects/87b332e62f9d4603ae443f3fd2e8f0fb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:41.222064 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:41.223616 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:41.239892 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a5196-7499-4c27-8274-58b6827583a4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:41.299207 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:41.299836 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:41.300118 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:41.300391 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] PATH_INFO: `/v3/users/93bf44bba277481886b77a7beea70745` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:41.301553 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bf44bba277481886b77a7beea70745)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:41.303492 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:41.326842 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:41.616985 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bf44bba277481886b77a7beea70745'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.629542 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bf44bba277481886b77a7beea70745'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.638839 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bf44bba277481886b77a7beea70745'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.639565 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bf44bba277481886b77a7beea70745'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.727277 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a2f4640-92bd-470d-99f7-1c72f8095936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bf44bba277481886b77a7beea70745'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:41.734712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1446/2862] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:35:41 2022] DELETE /identity/v3/users/93bf44bba277481886b77a7beea70745 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:42.009412 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:42.012097 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:42.031884 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dfd5f-2ac9-4b19-ae22-8c7491424539 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:42.088943 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:42.089581 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.089872 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.090150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] PATH_INFO: `/v3/projects/e5b4a62037cc44699512a260885663da` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.092139 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b4a62037cc44699512a260885663da)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:42.094698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:42.189278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:42.202773 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b4a62037cc44699512a260885663da', 'request_id': 'req-ba970993-0e1b-41ee-a800-0a471b525f7f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:42.208344 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b4a62037cc44699512a260885663da', 'request_id': 'req-ba970993-0e1b-41ee-a800-0a471b525f7f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:42.297432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b4a62037cc44699512a260885663da', 'request_id': 'req-ba970993-0e1b-41ee-a800-0a471b525f7f'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:42.309035 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] The token cache is being invalidate because project e5b4a62037cc44699512a260885663da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:35:42.309350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:42.310084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ba970993-0e1b-41ee-a800-0a471b525f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:35:42.311604 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1417/2863] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:35:42 2022] DELETE /identity/v3/projects/e5b4a62037cc44699512a260885663da => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:42.316713 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e62dc9-a6f1-41a1-b65f-2691e46558fc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.317218 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e62dc9-a6f1-41a1-b65f-2691e46558fc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.317410 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e62dc9-a6f1-41a1-b65f-2691e46558fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.337792 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-62e62dc9-a6f1-41a1-b65f-2691e46558fc None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:42.339061 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62e62dc9-a6f1-41a1-b65f-2691e46558fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:42.401140 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1447/2864] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:42.409639 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755d04-c732-4308-a8d8-692381916e7b None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.409924 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755d04-c732-4308-a8d8-692381916e7b None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.410200 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755d04-c732-4308-a8d8-692381916e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.430717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-4a755d04-c732-4308-a8d8-692381916e7b None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:42.431928 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4a755d04-c732-4308-a8d8-692381916e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:42.440554 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1418/2865] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:42.444891 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e62dc9-a6f1-41a1-b65f-2691e46558fc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:42.455744 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e62dc9-a6f1-41a1-b65f-2691e46558fc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:42.460321 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:42.461138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.461266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.461450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.462112 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:35:42.462417 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:42.464036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:42.476866 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1448/2866] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:35:42.481540 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a755d04-c732-4308-a8d8-692381916e7b None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:42.491298 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a755d04-c732-4308-a8d8-692381916e7b None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:42.496113 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:42.496712 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.497029 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.497318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.497939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:42.499857 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:42.609050 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1419/2867] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:35:42 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:35:42.613591 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:42.624355 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52685ef0-e363-4268-9730-dd9384afd448 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:42.682348 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:42.683001 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.683285 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.683563 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.684193 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:42.686131 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:42.771295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1449/2868] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:35:42 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:35:42.775682 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:42.787069 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964a549-4613-42fc-bbc2-0a27ec12a191 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:42.791737 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:42.792342 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.792622 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.792896 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.793529 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:42.795491 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:42.805683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1420/2869] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:42.810536 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:42.821191 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117275-36b1-4b29-8294-2173137c169c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:42.827335 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc06a6-c7dc-40da-86e1-bf6191cb7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:42.827936 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc06a6-c7dc-40da-86e1-bf6191cb7933 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.828224 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc06a6-c7dc-40da-86e1-bf6191cb7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.828504 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc06a6-c7dc-40da-86e1-bf6191cb7933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.829151 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc06a6-c7dc-40da-86e1-bf6191cb7933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:42.830777 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc06a6-c7dc-40da-86e1-bf6191cb7933 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:42.841635 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1450/2870] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:35:42.845866 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:42.855752 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c75fa1-8b3b-4fa0-b151-99a078593032 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:42.860487 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:42.861075 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.861360 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.861642 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] PATH_INFO: `/v3/projects/11e6c60b7ffd40aaaa55f1f278a1395f/users/642a52ae2d67477496f27130ad04c9dc/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.876876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e6c60b7ffd40aaaa55f1f278a1395f, user_id=642a52ae2d67477496f27130ad04c9dc, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:42.879559 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:42.955217 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1421/2871] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:35:42 2022] PUT /identity/v3/projects/11e6c60b7ffd40aaaa55f1f278a1395f/users/642a52ae2d67477496f27130ad04c9dc/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:35:42.966943 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292231e-38a3-47c3-b8d4-ee71c4b24ce4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:42.967229 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292231e-38a3-47c3-b8d4-ee71c4b24ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:42.967508 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292231e-38a3-47c3-b8d4-ee71c4b24ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:42.975698 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:42.997888 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d292231e-38a3-47c3-b8d4-ee71c4b24ce4 None None] MFA Rules not processed for user `642a52ae2d67477496f27130ad04c9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:35:42.999130 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d292231e-38a3-47c3-b8d4-ee71c4b24ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:43.188714 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1451/2872] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:35:43.201514 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:43.203305 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:43.282390 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cbf0a-35f4-4296-9270-59d64dedb04d admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:43.286056 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22296cd-65e3-4617-b118-03d369aac2b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e3e10f9efeb4b908bf3d74ce1eb6a3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:43.286692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22296cd-65e3-4617-b118-03d369aac2b0 service glance] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:43.286982 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22296cd-65e3-4617-b118-03d369aac2b0 service glance] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:43.287260 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22296cd-65e3-4617-b118-03d369aac2b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:43.296923 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22296cd-65e3-4617-b118-03d369aac2b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:43.298350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22296cd-65e3-4617-b118-03d369aac2b0 service glance] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:43.307191 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1422/2873] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:53.224256 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=30 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:53.303410 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:36:19.727363 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292231e-38a3-47c3-b8d4-ee71c4b24ce4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:19.789825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292231e-38a3-47c3-b8d4-ee71c4b24ce4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:19.795143 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:19.795854 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:19.796119 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:19.796394 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] PATH_INFO: `/v3/users/642a52ae2d67477496f27130ad04c9dc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:19.797603 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642a52ae2d67477496f27130ad04c9dc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:19.799609 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:19.998181 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642a52ae2d67477496f27130ad04c9dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:20.010312 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642a52ae2d67477496f27130ad04c9dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:20.017268 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642a52ae2d67477496f27130ad04c9dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:20.017967 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642a52ae2d67477496f27130ad04c9dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:20.115042 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642a52ae2d67477496f27130ad04c9dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:20.121676 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1452/2874] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:36:19 2022] DELETE /identity/v3/users/642a52ae2d67477496f27130ad04c9dc => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:36:20.126680 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:20.127196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:20.127311 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:20.146215 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:36:20.156124 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:20.207735 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1423/2875] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:36:20.217870 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:20.219350 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:20.277552 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fde70-6c2e-4196-8a4d-e13f91f833d4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:20.281138 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a828a4-6d95-4c3c-8754-30e738d70259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:20.281766 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a828a4-6d95-4c3c-8754-30e738d70259 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:20.282044 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a828a4-6d95-4c3c-8754-30e738d70259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:20.282317 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a828a4-6d95-4c3c-8754-30e738d70259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:20.291642 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a828a4-6d95-4c3c-8754-30e738d70259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:20.293716 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a828a4-6d95-4c3c-8754-30e738d70259 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:20.303819 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1453/2876] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:36:20.797088 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:20.798683 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:20.810805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ee73a-6915-49e0-a736-e5f1cfe86c42 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:20.815656 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:20.816318 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:20.816576 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:20.816855 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] PATH_INFO: `/v3/projects/11e6c60b7ffd40aaaa55f1f278a1395f` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:20.818004 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e6c60b7ffd40aaaa55f1f278a1395f)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:20.819967 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:20.951170 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e6c60b7ffd40aaaa55f1f278a1395f', 'request_id': 'req-d089e3d3-219f-4bb6-96b4-bf32deca4453'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:20.956763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e6c60b7ffd40aaaa55f1f278a1395f', 'request_id': 'req-d089e3d3-219f-4bb6-96b4-bf32deca4453'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:21.040649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e6c60b7ffd40aaaa55f1f278a1395f', 'request_id': 'req-d089e3d3-219f-4bb6-96b4-bf32deca4453'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:21.052300 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] The token cache is being invalidate because project 11e6c60b7ffd40aaaa55f1f278a1395f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:36:21.056320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:21.056320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-d089e3d3-219f-4bb6-96b4-bf32deca4453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:21.056320 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1424/2877] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:36:20 2022] DELETE /identity/v3/projects/11e6c60b7ffd40aaaa55f1f278a1395f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:36:21.060503 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a387e-090a-40b0-a2f0-3ad3b97114c3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.060975 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a387e-090a-40b0-a2f0-3ad3b97114c3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.061088 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a387e-090a-40b0-a2f0-3ad3b97114c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.081619 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ed0a387e-090a-40b0-a2f0-3ad3b97114c3 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:36:21.082876 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ed0a387e-090a-40b0-a2f0-3ad3b97114c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:21.100300 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:36:21.142970 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1454/2878] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:36:21.150831 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255edafa-6cb2-43e3-998e-639ed1426547 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.151321 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255edafa-6cb2-43e3-998e-639ed1426547 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.151449 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255edafa-6cb2-43e3-998e-639ed1426547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.172122 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-255edafa-6cb2-43e3-998e-639ed1426547 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:36:21.173355 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-255edafa-6cb2-43e3-998e-639ed1426547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:21.181392 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1425/2879] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:36:21.186450 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a387e-090a-40b0-a2f0-3ad3b97114c3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:21.196527 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a387e-090a-40b0-a2f0-3ad3b97114c3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:21.202889 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:21.203495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.203778 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.204052 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.204697 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:36:21.205036 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:21.206806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:21.218825 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1455/2880] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 17 20:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:36:21.223287 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255edafa-6cb2-43e3-998e-639ed1426547 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:21.233071 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255edafa-6cb2-43e3-998e-639ed1426547 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:21.237778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:21.238649 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.238948 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.239251 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.239876 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:21.241778 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:21.356937 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1426/2881] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 17 20:36:21 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:36:21.361124 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:21.372142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889601e6-c2ce-4dc2-bb26-cfb6d604aa4b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:21.431339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:21.431945 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.432228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.432508 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.433803 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:21.435828 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:21.539664 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1456/2882] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 17 20:36:21 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:36:21.544717 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:21.555220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0fe2c-dc38-40a5-8916-e17bcc15c6e3 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:21.561242 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:21.562080 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.564226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.564226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.564226 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:21.565562 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:21.576569 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1427/2883] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:36:21.580712 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:21.591205 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebe238-8d29-4b1d-a918-57fc1afdfd77 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:21.596219 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96a30-9344-4bdf-a99e-77d2526b190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:21.596829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96a30-9344-4bdf-a99e-77d2526b190d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.597142 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96a30-9344-4bdf-a99e-77d2526b190d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.597421 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96a30-9344-4bdf-a99e-77d2526b190d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.598067 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96a30-9344-4bdf-a99e-77d2526b190d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:21.599729 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96a30-9344-4bdf-a99e-77d2526b190d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:21.611415 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1457/2884] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 17 20:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:36:21.615730 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:21.626615 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e917f-3dc9-41b4-bf81-43f153bcc235 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:21.631301 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:21.631953 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.632236 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.632520 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] PATH_INFO: `/v3/projects/ae95158b89ff4c278503483a3f565ca4/users/8d4141aea44a4d9c9435fb8e6b17ecb3/roles/f4d54ec4c8844bc6a93b694e46f8da14` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.647654 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae95158b89ff4c278503483a3f565ca4, user_id=8d4141aea44a4d9c9435fb8e6b17ecb3, role_id=f4d54ec4c8844bc6a93b694e46f8da14)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:21.650350 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:21.772438 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1428/2885] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 17 20:36:21 2022] PUT /identity/v3/projects/ae95158b89ff4c278503483a3f565ca4/users/8d4141aea44a4d9c9435fb8e6b17ecb3/roles/f4d54ec4c8844bc6a93b694e46f8da14 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:36:21.784834 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c0b01-3cdc-49af-8bd0-8ea4c5235454 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.785121 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c0b01-3cdc-49af-8bd0-8ea4c5235454 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.787688 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c0b01-3cdc-49af-8bd0-8ea4c5235454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.813228 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-479c0b01-3cdc-49af-8bd0-8ea4c5235454 None None] MFA Rules not processed for user `8d4141aea44a4d9c9435fb8e6b17ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:36:21.814442 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-479c0b01-3cdc-49af-8bd0-8ea4c5235454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:21.879305 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1458/2886] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:36:21.891381 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:21.893063 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:21.914940 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:36:21.952271 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d670d8-36ff-4c33-b20e-61f694969955 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:21.956805 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ef8f1-cf32-47ae-b812-dd7b8869466c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac7372634fa47df8d7fb36c98f7e0ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:21.957414 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ef8f1-cf32-47ae-b812-dd7b8869466c service cinder] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:21.957699 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ef8f1-cf32-47ae-b812-dd7b8869466c service cinder] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:21.957980 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ef8f1-cf32-47ae-b812-dd7b8869466c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:21.967006 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ef8f1-cf32-47ae-b812-dd7b8869466c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:21.968465 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ef8f1-cf32-47ae-b812-dd7b8869466c service cinder] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:21.977572 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1429/2887] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:36:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:36:31.270214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c0b01-3cdc-49af-8bd0-8ea4c5235454 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:31.289773 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:36:31.335365 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c0b01-3cdc-49af-8bd0-8ea4c5235454 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:31.340083 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:31.340708 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:31.340992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:31.341266 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] PATH_INFO: `/v3/users/8d4141aea44a4d9c9435fb8e6b17ecb3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:31.342640 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4141aea44a4d9c9435fb8e6b17ecb3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:31.345361 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:31.528845 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4141aea44a4d9c9435fb8e6b17ecb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:31.540886 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4141aea44a4d9c9435fb8e6b17ecb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:31.549110 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4141aea44a4d9c9435fb8e6b17ecb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:31.549829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4141aea44a4d9c9435fb8e6b17ecb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:31.633214 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4141aea44a4d9c9435fb8e6b17ecb3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:31.639578 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1459/2888] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:36:31 2022] DELETE /identity/v3/users/8d4141aea44a4d9c9435fb8e6b17ecb3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:36:31.650655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] REQUEST_METHOD: `POST` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:31.650655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:31.650655 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:31.664150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.auth.core [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] MFA Rules not processed for user `55cfb5b1f26a4ec19b12e7ce5108fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:36:31.665351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:31.728957 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1430/2889] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 17 20:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:36:31.739769 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:31.741314 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:31.799545 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafc6d-c843-4dbe-8e3f-c6ba17fd6f76 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:31.803129 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:31.803733 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:31.804017 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:31.804295 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:31.813339 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:31.814797 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:31.824312 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1460/2890] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:36:32.282900 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:36:32.284525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:36:32.297424 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5cd3c-1517-4120-95e4-4bc50132f4d9 None None] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:36:32.302066 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:36:32.302720 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:36:32.303007 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:36:32.303433 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] PATH_INFO: `/v3/projects/ae95158b89ff4c278503483a3f565ca4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:36:32.304432 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae95158b89ff4c278503483a3f565ca4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:36:32.306351 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:36:32.418939 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae95158b89ff4c278503483a3f565ca4', 'request_id': 'req-17ef5384-67bd-4637-95e0-cf5435235028'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:32.424525 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae95158b89ff4c278503483a3f565ca4', 'request_id': 'req-17ef5384-67bd-4637-95e0-cf5435235028'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:32.530605 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae95158b89ff4c278503483a3f565ca4', 'request_id': 'req-17ef5384-67bd-4637-95e0-cf5435235028'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:32.543472 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] The token cache is being invalidate because project ae95158b89ff4c278503483a3f565ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:36:32.543892 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:32.544643 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:36:32.546278 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1431/2891] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:36:32 2022] DELETE /identity/v3/projects/ae95158b89ff4c278503483a3f565ca4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:36:41.819983 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:36:42.539521 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:23.560905 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:23.569832 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992930d-5124-4325-a063-c08e95331db3 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:23.624753 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:23.625372 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:23.625651 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:23.625930 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:23.627996 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:23.638069 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:23.639471 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:23.647960 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1461/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:37:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:37:23.944248 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:23.945694 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:23.958978 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef5384-67bd-4637-95e0-cf5435235028 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:23.962711 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:23.963324 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:23.963637 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:23.963917 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:23.965658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:24.041240 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:24.042718 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:24.054669 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1432/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:37:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:37:25.238134 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:25.246818 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df79492-b1ad-41c5-9825-6f6feba4a1d2 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:25.250958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:25.251567 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:25.251850 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:25.252127 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:25.253844 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:25.268103 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:25.269554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:25.281689 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1462/2894] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:37:26.673526 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:26.675235 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:26.698081 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bf9eb-ac78-4a84-97df-bb49b38160a6 service neutron] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:26.704995 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78694291dba47f1b833c721cb728460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:26.705698 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:26.706692 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:26.707167 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:26.709159 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:26.724247 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:26.725856 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:26.740460 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1433/2895] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:37:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:37:35.275833 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=32 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:36.734262 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=40 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:40.949809 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:40.951275 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:40.962167 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c7985-8bdb-498c-8b00-d95fa238d34f service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:40.965774 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765ee8241c4e448eb999016b17132e37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:40.966373 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:40.966675 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:40.966958 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:40.969247 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:41.033380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:41.034829 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:41.044495 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1463/2896] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:37:48.612308 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:48.613784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:48.696769 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee5067-6a1a-4f4a-8590-06a5cd0ed1a4 service nova] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:48.701411 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:48.702563 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:48.702871 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:48.706220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] PATH_INFO: `/v3/users/79b37b77e3e44797b58ef9dd89747ca4` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:48.706220 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b37b77e3e44797b58ef9dd89747ca4)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:48.706457 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:48.921030 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b37b77e3e44797b58ef9dd89747ca4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:48.932956 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b37b77e3e44797b58ef9dd89747ca4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:48.933614 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b37b77e3e44797b58ef9dd89747ca4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.004588 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b37b77e3e44797b58ef9dd89747ca4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.005128 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b37b77e3e44797b58ef9dd89747ca4'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.019084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1434/2897] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:37:48 2022] DELETE /identity/v3/users/79b37b77e3e44797b58ef9dd89747ca4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:37:49.298357 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:49.354274 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04ef8-c034-4098-9733-516ca1b68da3 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:49.410831 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:49.411475 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:49.411756 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:49.412033 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] PATH_INFO: `/v3/projects/62ed5118006d48e8a68f1f4506e54546` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:49.413175 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ed5118006d48e8a68f1f4506e54546)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:49.415107 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:49.591416 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ed5118006d48e8a68f1f4506e54546', 'request_id': 'req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.596685 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:49.597992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ed5118006d48e8a68f1f4506e54546', 'request_id': 'req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.741917 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ed5118006d48e8a68f1f4506e54546', 'request_id': 'req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.753992 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] The token cache is being invalidate because project 62ed5118006d48e8a68f1f4506e54546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:37:49.754282 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.754995 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:49.756554 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1464/2898] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:37:49 2022] DELETE /identity/v3/projects/62ed5118006d48e8a68f1f4506e54546 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:37:49.760658 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:49.762437 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:49.776232 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d892-8804-4c37-b714-2aaec008f361 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:49.836145 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:49.836779 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:49.837060 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:49.837337 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] PATH_INFO: `/v3/users/f33b14dcb9164f6c88ddcc05162b3db1` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:49.838477 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33b14dcb9164f6c88ddcc05162b3db1)` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:49.840508 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:49.853196 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:50.053150 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33b14dcb9164f6c88ddcc05162b3db1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.065763 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33b14dcb9164f6c88ddcc05162b3db1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.066442 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33b14dcb9164f6c88ddcc05162b3db1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.142098 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33b14dcb9164f6c88ddcc05162b3db1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.142663 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.notifications [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33b14dcb9164f6c88ddcc05162b3db1'} {{(pid=81779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.156084 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1435/2899] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 17 20:37:49 2022] DELETE /identity/v3/users/f33b14dcb9164f6c88ddcc05162b3db1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:37:50.429455 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:37:50.430972 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:37:50.444721 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0474a3-b0f8-488b-a45b-b9e677f3d9e7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:37:50.505516 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55cfb5b1f26a4ec19b12e7ce5108fd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036067fc874c4d13970eee6f98f3d00e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:37:50.506202 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:37:50.506488 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:37:50.506806 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] PATH_INFO: `/v3/projects/361c3f9f98a54379a89cfdd049abc1df` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:37:50.507953 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361c3f9f98a54379a89cfdd049abc1df)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:37:50.509846 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:37:50.622267 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361c3f9f98a54379a89cfdd049abc1df', 'request_id': 'req-e470808d-25b4-4395-bf5e-24e37da84273'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.628184 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361c3f9f98a54379a89cfdd049abc1df', 'request_id': 'req-e470808d-25b4-4395-bf5e-24e37da84273'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.702380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361c3f9f98a54379a89cfdd049abc1df', 'request_id': 'req-e470808d-25b4-4395-bf5e-24e37da84273'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.714465 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] The token cache is being invalidate because project 361c3f9f98a54379a89cfdd049abc1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:37:50.714791 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.715437 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e470808d-25b4-4395-bf5e-24e37da84273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:37:50.716927 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1465/2900] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 17 20:37:50 2022] DELETE /identity/v3/projects/361c3f9f98a54379a89cfdd049abc1df => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:38:00.152091 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:38:00.711380 dv-cinder-835384-19-iscsi devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:40:31.815086 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Authenticating user token {{(pid=81779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:40:31.816580 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:40:31.921784 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164b292-55b3-43fe-b04d-c5c45c259246 admin admin] Validating token access rules against request {{(pid=81779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:40:31.980670 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f2692-9fd3-4f16-afd6-f2c2d40ec058 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3ab28e46424895b2c730edfdcc7cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c3c3e62ee0461c9fdcb6491c8178c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:40:31.981286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f2692-9fd3-4f16-afd6-f2c2d40ec058 service placement] REQUEST_METHOD: `GET` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:40:31.981571 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f2692-9fd3-4f16-afd6-f2c2d40ec058 service placement] SCRIPT_NAME: `/identity` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:40:31.981850 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f2692-9fd3-4f16-afd6-f2c2d40ec058 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:40:31.983838 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.fernet_utils [None req-481f2692-9fd3-4f16-afd6-f2c2d40ec058 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:40:31.995454 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f2692-9fd3-4f16-afd6-f2c2d40ec058 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:40:31.997019 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f2692-9fd3-4f16-afd6-f2c2d40ec058 service placement] RBAC: Authorization granted {{(pid=81779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:40:32.007550 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: [pid: 81779|app: 0|req: 1436/2901] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 17 20:40:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:40:42.003286 dv-cinder-835384-19-iscsi devstack@keystone.service[81779]: DEBUG dbcounter [-] [81779] Writing DB stats keystone:SELECT=74 {{(pid=81779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}